Mid
DeepSeek V3
Published evidence on 259 tasks. Inspect each benchmark before choosing a route.
Published task evidence
42.0% pass rate · 80% quality floor · 19.61s p50
Below the quality floor
69.0% pass rate · 80% quality floor · 25.36s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 10.06s p50
Clears the quality floor
59.0% pass rate · 80% quality floor · 10.58s p50
Below the quality floor
79.0% pass rate · 80% quality floor · 6.12s p50
Below the quality floor
69.0% pass rate · 80% quality floor · 1.99s p50
Below the quality floor
90.0% pass rate · 80% quality floor · 0.83s p50
Cheapest passing model
94.0% pass rate · 80% quality floor · 3.89s p50
Clears the quality floor
34.0% pass rate · 80% quality floor · 6.58s p50
Below the quality floor
18.0% pass rate · 80% quality floor · 7.36s p50
Below the quality floor
96.0% pass rate · 80% quality floor · 1.69s p50
Clears the quality floor
64.0% pass rate · 80% quality floor · 3.03s p50
Below the quality floor
60.0% pass rate · 80% quality floor · 1.36s p50
Below the quality floor
95.0% pass rate · 80% quality floor · 3.56s p50
Clears the quality floor
55.0% pass rate · 80% quality floor · 1.90s p50
Below the quality floor
100.0% pass rate · 80% quality floor · 1.76s p50
Clears the quality floor
44.0% pass rate · 80% quality floor · 6.03s p50
Below the quality floor
52.0% pass rate · 80% quality floor · 10.86s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 2.00s p50
Clears the quality floor
89.1% pass rate · 80% quality floor · 9.79s p50
Clears the quality floor
34.7% pass rate · 80% quality floor · 13.73s p50
Below the quality floor
27.0% pass rate · 80% quality floor · 4.11s p50
Below the quality floor
72.0% pass rate · 80% quality floor · 9.36s p50
Below the quality floor
99.0% pass rate · 80% quality floor · 10.64s p50
Clears the quality floor
59.0% pass rate · 80% quality floor · 11.60s p50
Below the quality floor
90.0% pass rate · 80% quality floor · 3.59s p50
Clears the quality floor
82.0% pass rate · 80% quality floor · 7.98s p50
Clears the quality floor
30.0% pass rate · 80% quality floor · 1.16s p50
Below the quality floor
13.0% pass rate · 80% quality floor · 11.30s p50
Below the quality floor
30.0% pass rate · 80% quality floor · 14.13s p50
Below the quality floor
37.0% pass rate · 80% quality floor · 8.21s p50
Below the quality floor
53.0% pass rate · 80% quality floor · 9.83s p50
Below the quality floor
69.0% pass rate · 80% quality floor · 13.68s p50
Below the quality floor
40.0% pass rate · 80% quality floor · 0.77s p50
Below the quality floor
74.0% pass rate · 80% quality floor · 1.70s p50
Below the quality floor
81.0% pass rate · 80% quality floor · 7.36s p50
Cheapest passing model
1.0% pass rate · 80% quality floor · 12.22s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 6.59s p50
Clears the quality floor
46.0% pass rate · 80% quality floor · 16.11s p50
Below the quality floor
55.0% pass rate · 80% quality floor · 4.01s p50
Below the quality floor
42.0% pass rate · 80% quality floor · 7.75s p50
Below the quality floor
88.0% pass rate · 80% quality floor · 0.74s p50
Clears the quality floor
64.0% pass rate · 80% quality floor · 5.59s p50
Below the quality floor
99.0% pass rate · 80% quality floor · 1.26s p50
Clears the quality floor
97.0% pass rate · 80% quality floor · 0.71s p50
Clears the quality floor
64.9% pass rate · 80% quality floor · 10.25s p50
Below the quality floor
91.0% pass rate · 80% quality floor · 16.79s p50
Clears the quality floor
26.0% pass rate · 80% quality floor · 10.28s p50
Below the quality floor
86.5% pass rate · 80% quality floor · 12.63s p50
Clears the quality floor
72.0% pass rate · 80% quality floor · 12.19s p50
Below the quality floor
63.5% pass rate · 80% quality floor · 7.90s p50
Below the quality floor
99.0% pass rate · 80% quality floor · 8.58s p50
Clears the quality floor
96.0% pass rate · 80% quality floor · 5.43s p50
Clears the quality floor
58.0% pass rate · 80% quality floor · 9.79s p50
Below the quality floor
84.0% pass rate · 80% quality floor · 16.57s p50
Clears the quality floor
89.0% pass rate · 80% quality floor · 0.81s p50
Clears the quality floor
92.0% pass rate · 80% quality floor · 1.82s p50
Clears the quality floor
39.0% pass rate · 80% quality floor · 9.63s p50
Below the quality floor
100.0% pass rate · 80% quality floor · 5.20s p50
Clears the quality floor
97.0% pass rate · 80% quality floor · 8.75s p50
Clears the quality floor
38.0% pass rate · 80% quality floor · 4.05s p50
Below the quality floor
98.0% pass rate · 80% quality floor · 9.25s p50
Clears the quality floor
85.0% pass rate · 80% quality floor · 6.50s p50
Cheapest passing model
85.0% pass rate · 80% quality floor · 12.93s p50
Clears the quality floor
74.0% pass rate · 80% quality floor · 0.84s p50
Below the quality floor
19.0% pass rate · 80% quality floor · 2.77s p50
Below the quality floor
66.0% pass rate · 80% quality floor · 7.73s p50
Below the quality floor
88.0% pass rate · 80% quality floor · 0.76s p50
Clears the quality floor
100.0% pass rate · 80% quality floor · 2.92s p50
Clears the quality floor
61.0% pass rate · 80% quality floor · 4.06s p50
Below the quality floor
89.0% pass rate · 80% quality floor · 12.24s p50
Clears the quality floor
100.0% pass rate · 80% quality floor · 5.75s p50
Clears the quality floor
85.0% pass rate · 80% quality floor · 9.27s p50
Clears the quality floor
19.0% pass rate · 80% quality floor · 2.09s p50
Below the quality floor
64.0% pass rate · 80% quality floor · 0.76s p50
Below the quality floor
93.0% pass rate · 80% quality floor · 0.70s p50
Clears the quality floor
99.0% pass rate · 80% quality floor · 1.80s p50
Clears the quality floor
97.0% pass rate · 80% quality floor · 0.71s p50
Clears the quality floor
1.0% pass rate · 80% quality floor · 10.75s p50
Below the quality floor
45.6% pass rate · 80% quality floor · 8.96s p50
Below the quality floor
Playground and routes select qualified candidates for the task; they do not pin this model.
Price by provider
| Provider | Input | Output | Observed |
|---|---|---|---|
| Neurometric Configured deployment price | $0.58 | $1.68 | 10/2/2026, 7:17:02 PM UTC |
| OpenRouter Observed router listing | $0.29 | $1.14 | 10/2/2026, 7:45:04 PM UTC |
| TrustedRouter Observed router listing | $0.3376 | $0.939 | 10/2/2026, 7:45:08 PM UTC |