Small · 4B
Qwen3 4B Instruct 2507
Published evidence on 263 tasks. Inspect each benchmark before choosing a route.
Published task evidence
21.0% pass rate · 80% quality floor · 69.61s p50
Below the quality floor
4.0% pass rate · 80% quality floor · 70.73s p50
Below the quality floor
40.0% pass rate · 80% quality floor · 67.73s p50
Below the quality floor
47.0% pass rate · 80% quality floor · 8.25s p50
Below the quality floor
3.0% pass rate · 80% quality floor · 72.62s p50
Below the quality floor
36.0% pass rate · 80% quality floor · 57.09s p50
Below the quality floor
27.0% pass rate · 80% quality floor · 8.21s p50
Below the quality floor
66.0% pass rate · 80% quality floor · 1.87s p50
Below the quality floor
78.0% pass rate · 80% quality floor · 15.10s p50
Below the quality floor
1.0% pass rate · 80% quality floor · 34.98s p50
Below the quality floor
7.0% pass rate · 80% quality floor · 24.75s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 7.17s p50
Cheapest passing model
42.0% pass rate · 80% quality floor · 18.95s p50
Below the quality floor
18.0% pass rate · 80% quality floor · 17.53s p50
Below the quality floor
64.0% pass rate · 80% quality floor · 17.87s p50
Below the quality floor
32.0% pass rate · 80% quality floor · 8.02s p50
Below the quality floor
81.0% pass rate · 80% quality floor · 14.35s p50
Cheapest passing model
1.0% pass rate · 80% quality floor · 49.20s p50
Below the quality floor
29.0% pass rate · 80% quality floor · 78.09s p50
Below the quality floor
9.0% pass rate · 80% quality floor · 15.57s p50
Below the quality floor
77.2% pass rate · 80% quality floor · 85.24s p50
Below the quality floor
5.3% pass rate · 80% quality floor · 89.81s p50
Below the quality floor
0.0% pass rate · 80% quality floor · 30.37s p50
Below the quality floor
20.0% pass rate · 80% quality floor · 67.79s p50
Below the quality floor
71.1% pass rate · 80% quality floor · 100.88s p50
Below the quality floor
4.0% pass rate · 80% quality floor · 83.84s p50
Below the quality floor
61.0% pass rate · 80% quality floor · 13.44s p50
Below the quality floor
45.0% pass rate · 80% quality floor · 80.54s p50
Below the quality floor
24.0% pass rate · 80% quality floor · 3.69s p50
Below the quality floor
0.0% pass rate · 80% quality floor · 91.46s p50
Below the quality floor
0.0% pass rate · 80% quality floor · 92.70s p50
Below the quality floor
5.0% pass rate · 80% quality floor · 82.01s p50
Below the quality floor
16.0% pass rate · 80% quality floor · 75.48s p50
Below the quality floor
26.0% pass rate · 80% quality floor · 81.84s p50
Below the quality floor
31.0% pass rate · 80% quality floor · 2.96s p50
Below the quality floor
22.0% pass rate · 80% quality floor · 26.63s p50
Below the quality floor
46.0% pass rate · 80% quality floor · 73.46s p50
Below the quality floor
0.0% pass rate · 80% quality floor · 89.29s p50
Below the quality floor
64.0% pass rate · 80% quality floor · 59.55s p50
Below the quality floor
7.0% pass rate · 80% quality floor · 104.23s p50
Below the quality floor
63.0% pass rate · 80% quality floor · 70.03s p50
Below the quality floor
5.0% pass rate · 80% quality floor · 10.82s p50
Below the quality floor
30.0% pass rate · 80% quality floor · 26.25s p50
Below the quality floor
79.0% pass rate · 80% quality floor · 3.25s p50
Below the quality floor
64.0% pass rate · 80% quality floor · 14.39s p50
Below the quality floor
2.0% pass rate · 80% quality floor · 49.03s p50
Below the quality floor
81.0% pass rate · 80% quality floor · 7.00s p50
Cheapest passing model
97.0% pass rate · 80% quality floor · 2.00s p50
Cheapest passing model
3.1% pass rate · 80% quality floor · 73.91s p50
Below the quality floor
59.0% pass rate · 80% quality floor · 44.42s p50
Below the quality floor
5.0% pass rate · 80% quality floor · 70.95s p50
Below the quality floor
13.5% pass rate · 80% quality floor · 78.58s p50
Below the quality floor
27.0% pass rate · 80% quality floor · 81.15s p50
Below the quality floor
19.8% pass rate · 80% quality floor · 60.82s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 51.85s p50
Cheapest passing model
77.0% pass rate · 80% quality floor · 21.35s p50
Below the quality floor
21.0% pass rate · 80% quality floor · 77.30s p50
Below the quality floor
28.0% pass rate · 80% quality floor · 97.50s p50
Below the quality floor
77.0% pass rate · 80% quality floor · 4.55s p50
Below the quality floor
85.0% pass rate · 80% quality floor · 18.05s p50
Cheapest passing model
11.0% pass rate · 80% quality floor · 74.23s p50
Below the quality floor
81.0% pass rate · 80% quality floor · 41.20s p50
Cheapest passing model
27.0% pass rate · 80% quality floor · 60.69s p50
Below the quality floor
14.0% pass rate · 80% quality floor · 22.61s p50
Below the quality floor
72.0% pass rate · 80% quality floor · 10.84s p50
Below the quality floor
62.0% pass rate · 80% quality floor · 61.71s p50
Below the quality floor
46.0% pass rate · 80% quality floor · 58.20s p50
Below the quality floor
58.0% pass rate · 80% quality floor · 5.16s p50
Below the quality floor
20.0% pass rate · 80% quality floor · 28.21s p50
Below the quality floor
6.0% pass rate · 80% quality floor · 50.70s p50
Below the quality floor
84.0% pass rate · 80% quality floor · 5.83s p50
Cheapest passing model
37.0% pass rate · 80% quality floor · 20.36s p50
Below the quality floor
22.0% pass rate · 80% quality floor · 14.22s p50
Below the quality floor
38.0% pass rate · 80% quality floor · 84.56s p50
Below the quality floor
92.0% pass rate · 80% quality floor · 28.85s p50
Cheapest passing model
63.0% pass rate · 80% quality floor · 66.12s p50
Below the quality floor
1.0% pass rate · 80% quality floor · 15.24s p50
Below the quality floor
69.0% pass rate · 80% quality floor · 4.62s p50
Below the quality floor
94.0% pass rate · 80% quality floor · 1.63s p50
Cheapest passing model
84.0% pass rate · 80% quality floor · 7.01s p50
Cheapest passing model
0.0% pass rate · 80% quality floor · 69.11s p50
Below the quality floor
26.7% pass rate · 80% quality floor · 58.99s p50
Below the quality floor
Playground and routes select qualified candidates for the task; they do not pin this model.
Price by provider
| Provider | Input | Output | Observed |
|---|---|---|---|
| TrustedRouter Observed router listing | $0.0106 | $0.0317 | 10/2/2026, 8:00:10 PM UTC |