Gemini 3.1 Pro Preview 2.00 12.00 compare (4) 1.0M 66K 57.2 #1 55.5 #1 GPT-5.3 Codex 1.75 14.00 compare (5) 400K 128K 53.6 #2 53.1 #2 Qwen3.6 Plus 0.325 1.95 compare (2) 1.0M 66K 50.0 #3 42.9 #7 MiniMax M2.7 0.300 1.20 compare (2) 205K 131K 49.6 #4 41.9 #9 MiMo V2 Pro 1.00 3.00 compare (2) 1.0M 131K 49.2 #5 41.4 #10 GPT-5.2 Codex 1.75 14.00 compare (4) 400K 128K 49.0 #6 43.0 #6 Grok 4 20 3.00 15.00 compare (1) 131K N/A 48.5 #7 40.5 #13 GLM-5 Turbo 1.20 4.00 compare (2) 203K 131K 46.8 #8 36.8 #22 Claude Opus 4.6 5.00 25.00 compare (7) 1.0M 128K 46.5 #9 47.6 #3 GPT-5 Codex 1.25 10.00 compare (4) 400K 128K 44.6 #10 38.9 #16 KwaiPilot KAT 2 Pro Coder 0.300 1.20 compare (2) 256K 80K 43.8 #11 45.6 #4 GLM-5.1 0.950 3.15 compare (2) 203K 66K 43.8 #12 35.8 #27 MiMo-V2-Omni 0.400 2.00 compare (1) 262K 66K 43.4 #13 35.5 #28 GPT-5.1 Codex 1.25 10.00 compare (4) 400K 128K 43.1 #15 36.6 #23 Claude Opus 4.5 5.00 25.00 compare (9) 410K 64K 43.1 #14 42.9 #8 GLM 5V Turbo 1.20 4.00 compare (2) 203K 131K 42.9 #16 36.2 #26 Claude Sonnet 4.6 3.00 15.00 compare (7) 1.0M 128K 42.6 #17 43.0 #5 MiniMax M2.5 0.118 0.990 compare (4) 1.0M 131K 41.9 #18 37.4 #21 Grok 4 3.00 15.00 compare (6) 2.0M N/A 41.5 #19 40.5 #12 Gemini 3 Pro Preview 2.00 12.00 compare (2) N/A N/A 41.3 #20 39.4 #14 Kimi K2 Thinking 0.574 1.20 compare (9) 262K 33K 40.9 #21 34.8 #29 o3 Pro 20.00 80.00 compare (4) 200K 100K 40.7 #22 N/A GLM-5 0.573 2.30 compare (5) 203K 131K 40.6 #23 39.0 #15 Qwen3.5 397B A17B 0.390 2.34 compare (3) 262K 66K 40.1 #24 37.4 #20 MiniMax M2.1 0.290 0.950 compare (7) 1.0M 131K 39.4 #25 32.8 #35 Qwen 3.5 Plus 0.115 0.688 compare (2) 1.0M 66K 38.6 #26 27.6 #50 Grok 4.1 Fast Reasoning 0.200 0.500 compare (3) 2.0M 30K 38.6 #28 30.9 #41 GPT-5.1 Codex Mini 0.250 2.00 compare (4) 400K 128K 38.6 #27 36.4 #25 o3 2.00 8.00 compare (5) 200K 100K 38.4 #29 38.4 #17 Step 3.5 Flash 0.100 0.300 compare (1) 262K 66K 37.8 #30 31.6 #40 Kimi K2.5 0.383 1.72 compare (8) 262K 98K 37.3 #31 25.8 #59 Qwen3.5 27B 0.195 1.56 compare (1) 262K 66K 37.2 #32 33.4 #34 Claude Sonnet 4.5 3.00 15.00 compare (10) 1.0M 64K 37.1 #33 33.5 #33 MiniMax M2 0.255 1.00 compare (7) 205K 131K 36.1 #34 29.2 #47 KAT-Coder-Pro V1 0.030 1.20 compare (1) 256K 32K 36.0 #36 18.3 #96 Claude Opus 4.1 15.00 75.00 compare (7) 200K 32K 36.0 #35 36.5 #24 Qwen3.5 122B A10B 0.260 2.08 compare (2) 262K 66K 35.9 #37 31.6 #39 GPT-5.4 2.50 15.00 compare (5) 1.1M 128K 35.4 #38 41.0 #11 Grok 4 Fast Reasoning 0.200 0.500 compare (3) 2.0M 256K 35.1 #39 27.4 #52 Gemini 3 Flash 0.500 3.00 compare (2) 1.0M 65K 35.0 #40 37.8 #19 Claude 3.7 Sonnet 3.00 15.00 compare (1) 200K 64K 34.7 #41 27.6 #51 GLM-4.7 0.390 1.75 compare (10) 205K 131K 34.2 #42 32.0 #36 GPT-5.2 1.75 14.00 compare (7) 410K 128K 33.6 #43 34.7 #30 Gemini 3.1 Flash Lite Preview 0.250 1.50 compare (4) 1.0M 66K 33.5 #44 30.1 #44 o4 Mini 1.00 4.00 compare (6) 200K 100K 33.1 #45 25.6 #61 Claude Sonnet 4 3.00 15.00 compare (10) 1.0M 64K 33.0 #47 30.6 #42 Claude Opus 4 15.00 75.00 compare (9) 410K 32K 33.0 #46 34.0 #31 Mercury 2 0.250 0.750 compare (2) 128K 50K 32.8 #48 30.6 #43 Qwen3 Max Thinking 0.780 3.90 compare (2) 262K 66K 32.5 #49 24.5 #66 Grok 3 Mini 0.250 0.500 compare (5) 131K N/A 32.1 #50 25.2 #64 Trinity Large Thinking 0.220 0.850 compare (2) 262K 80K 31.9 #51 27.2 #54 Qwen3 Max 0.780 3.90 compare (4) 262K 66K 31.4 #52 26.4 #56 Claude Haiku 4.5 1.00 5.00 compare (9) 200K 64K 31.1 #53 29.6 #46 o1 15.00 60.00 compare (5) 200K 100K 30.8 #55 20.5 #86 Claude Sonnet 3.7 3.00 15.00 compare (10) 200K 128K 30.8 #54 26.7 #55 Qwen3.5 35B A3B 0.163 1.30 compare (1) 262K 66K 30.7 #56 16.8 #102 MiMo 2 Flash 0.090 0.290 compare (3) 262K 66K 30.4 #57 25.8 #60 Gemini 2.5 Pro 1.25 10.00 compare (8) 1.0M 66K 29.5 #58 31.9 #38 DeepSeek V3.2 Speciale 0.400 1.20 compare (2) 164K N/A 29.4 #59 37.9 #18 Grok 4 Non-Reasoning 2.00 6.00 compare (2) 2.0M N/A 29.0 #61 22.0 #77 Grok 4 20 Non-Reasoning N/A N/A compare (3) 2.0M N/A 29.0 #60 22.0 #76 Grok Code 1 Fast 0.200 1.50 compare (5) 256K 10K 28.7 #63 23.7 #70 Grok 1 Code Fast N/A N/A compare (5) 256K 10K 28.7 #62 23.7 #69 DeepSeek V3.1 Terminus 0.210 0.790 compare (5) 164K 66K 28.5 #64 31.9 #37 DeepSeek V3.2 0.260 0.380 compare (11) 164K 66K 28.4 #65 30.0 #45 Qwen3 Coder Next 0.150 0.800 compare (4) 262K 66K 28.3 #66 22.9 #71 DeepSeek V3.1 0.150 0.750 compare (10) 164K 66K 27.7 #67 28.4 #48 Qwen3 VL 235B A22B 0.530 2.66 compare (1) 128K 8K 27.6 #68 20.9 #84 GPT-5.1 1.25 10.00 compare (7) 410K 128K 27.4 #69 27.3 #53 Qwen3.5 9B 0.050 0.150 compare (1) 256K 33K 27.3 #70 21.4 #82 Magistral Medium 1.2 2.00 5.00 compare (1) 128K N/A 27.1 #71 21.7 #80 Qwen3 Next 80B A3B 0.140 1.20 compare (1) 128K 8K 26.7 #72 19.5 #89 GLM-4.5 0.400 1.60 compare (6) 131K 98K 26.4 #73 26.3 #57 Kimi K2 0.570 2.30 compare (3) 262K 128K 26.3 #74 22.1 #74 GPT-4.1 2.00 8.00 compare (7) 1.0M 33K 26.3 #75 21.8 #79 Qwen3 Max Preview 1.20 6.00 compare (2) 262K 66K 26.1 #76 25.5 #62 Solar Pro 3 0.150 0.600 compare (1) 128K N/A 25.9 #79 13.3 #128 Qwen 3.5 Flash 0.100 0.400 compare (2) 1.0M 66K 25.9 #77 14.0 #121 o3 Mini 1.10 4.40 compare (5) 200K 100K 25.9 #78 17.9 #98 o1 Pro 150.00 600.00 compare (2) 200K 100K 25.8 #80 N/A Gemini 2.5 Flash Preview 0.150 2.50 compare (2) 1.0M 66K 25.7 #81 22.1 #73 o3 Mini High 1.10 4.40 compare (1) 200K 100K 25.2 #82 17.3 #101 Qwen3 Coder 480B A35B Instruct 0.220 1.30 compare (6) 262K 66K 24.8 #83 24.6 #65 Sonar Reasoning Pro 2.00 8.00 compare (3) 128K 8K 24.6 #84 N/A GPT OSS 120B 0.039 0.190 compare (17) 131K 131K 24.5 #85 15.5 #110 MiniMax M1 80K 0.100 0.100 compare (2) 1.0M 40K 24.4 #86 14.5 #116 GPT-5.4 Nano 0.200 1.25 compare (4) 1.1M 128K 24.4 #87 27.9 #49 o1 Preview 15.00 60.00 compare (2) 128K 33K 23.7 #88 34.0 #32 Grok 4.1 Fast 0.200 0.500 compare (3) 2.0M 30K 23.6 #89 19.5 #91 GLM-4.6 0.390 1.90 compare (8) 205K 131K 23.4 #90 19.7 #88 GPT-5.4 Mini 0.750 4.50 compare (4) 1.1M 128K 23.3 #91 25.3 #63 GLM-4.5 Air 0.130 0.850 compare (5) 131K 98K 23.2 #92 23.8 #67 Grok 4 Fast 0.200 0.500 compare (2) 2.0M 30K 23.1 #93 19.0 #94 GPT-4.1 Mini 0.400 1.60 compare (5) 1.0M 33K 22.9 #94 18.5 #95 Mistral Large 3 0.500 1.20 compare (4) 262K 8K 22.8 #95 22.7 #72 DeepSeek V3 0324 0.200 0.600 compare (9) 164K 16K 22.3 #96 22.0 #75 INTELLECT-3 0.200 1.10 compare (2) 131K N/A 22.2 #97 19.1 #93 GLM-4.7 Flash 0.060 0.400 compare (3) 203K 131K 22.1 #98 11.0 #144 Devstral 2 0.400 2.00 compare (1) 256K N/A 22.0 #99 23.7 #68 GPT-5 1.25 10.00 compare (9) 410K 128K 21.8 #100 21.2 #83 Grok 3 3.00 15.00 compare (5) 131K N/A 21.6 #101 19.8 #87 Mistral Medium 3.1 0.400 2.00 compare (2) 131K N/A 21.3 #102 18.3 #97 Qwen3 VL 235B A22B Instruct 0.200 0.880 compare (4) 262K 33K 20.8 #103 16.5 #104 GPT OSS 20B 0.030 0.140 compare (13) 131K 131K 20.8 #104 14.4 #117 GPT-5 Mini 0.250 2.00 compare (8) 400K 128K 20.7 #105 21.9 #78 o1 Mini 1.10 4.40 compare (3) 128K 66K 20.4 #106 N/A Qwen3 Next 80B A3B Instruct 0.090 0.900 compare (7) 262K 66K 20.1 #107 15.3 #111 Qwen3 Coder 30B A3B Instruct 0.070 0.270 compare (4) 262K 66K 20.0 #108 19.4 #92 Qwen3 235B A22B 0.180 0.540 compare (8) 262K 131K 19.8 #109 17.4 #100 QwQ 32B 0.150 0.200 compare (8) 131K 16K 19.7 #110 N/A Devstral Small 2 0.100 0.300 compare (1) 256K N/A 19.5 #111 20.7 #85 Gemini 2.5 Flash Lite Preview 0.100 0.400 compare (3) 1.0M 66K 19.4 #112 14.5 #114 Nova Premier 2.50 12.50 compare (3) 1.0M 32K 19.0 #113 13.8 #123 Mistral Medium 3 0.400 2.00 compare (2) 131K 8K 18.8 #115 13.6 #126 Magistral Medium 2.00 5.00 compare (2) 128K 64K 18.8 #114 16.0 #106 Devstral Medium 0.400 2.00 compare (2) 256K N/A 18.7 #117 15.9 #107 Claude Haiku 3.5 0.800 4.00 compare (7) 200K 8K 18.7 #116 10.7 #149 Llama 4 Maverick 0.150 0.600 compare (4) 1.0M 16K 18.4 #118 15.6 #109 Magistral Small 1.2 0.500 1.50 compare (1) 128K N/A 18.2 #119 14.8 #112 Nova 2 Lite 0.300 2.50 compare (3) 1.0M 66K 18.0 #120 12.5 #132 Devstral Small 1.0 0.100 0.300 compare (2) 131K N/A 18.0 #122 12.2 #134 Claude Opus 3 15.00 75.00 compare (5) 200K 4K 18.0 #121 19.5 #90 Sonar Reasoning 1.00 5.00 compare (2) 128K 8K 17.9 #123 N/A Gemini 2.5 Flash 0.150 0.600 compare (9) 1.0M 66K 17.8 #124 17.8 #99 Llama 3.1 405B Instruct 0.120 0.300 compare (11) 131K 16K 17.4 #125 14.5 #115 Qwen3 VL 32B Instruct 0.104 0.416 compare (3) 131K 33K 17.2 #126 15.6 #108 DeepSeek R1 Distill Qwen 32B 0.270 0.270 compare (6) 131K 32K 17.2 #127 N/A GLM-4.6 V 0.300 0.900 compare (3) 131K 33K 17.1 #128 11.1 #140 Qwen3 235B A22B Instruct 0.090 0.580 compare (7) 262K 33K 17.0 #129 14.0 #120 Magistral Small 0.500 1.50 compare (3) 128K 64K 16.8 #130 11.1 #139 DeepSeek V3 0.200 0.200 compare (12) 164K 82K 16.5 #131 16.4 #105 DeepSeek R1 0.280 0.420 compare (14) 164K 66K 16.4 #132 7.8 #160 Qwen3 VL 30B A3B Instruct 0.130 0.520 compare (4) 262K 33K 16.1 #133 14.3 #118 Ministral 3 14B 0.200 0.200 compare (1) 262K N/A 16.0 #135 10.9 #146 DeepSeek R1 Distill Llama 70B 0.200 0.600 compare (10) 131K 16K 16.0 #134 11.4 #137 DeepSeek R1 Distill Qwen 14B 0.070 0.070 compare (4) 131K 16K 15.8 #136 N/A Qwen2.5 72B Instruct 0.120 0.300 compare (7) 131K 16K 15.6 #137 11.9 #136 Sonar 1.00 1.00 compare (3) 128K 8K 15.5 #138 N/A Sonar Pro 3.00 15.00 compare (3) 200K 8K 15.2 #141 N/A QwQ 32B Preview 0.287 0.861 compare (2) 33K 16K 15.2 #139 N/A Devstral Small 0.100 0.300 compare (3) 256K 64K 15.2 #140 12.1 #135 Mistral Small 3.2 0.060 0.180 compare (1) 131K N/A 15.1 #143 13.3 #127 Mistral Large 2 2.00 6.00 compare (1) 128K 8K 15.1 #142 13.8 #124 Qwen3 30B A3B 0.080 0.280 compare (5) 131K 16K 15.0 #144 11.0 #141 NVIDIA Llama 3.1 Nemotron 1 Ultra 253B 0.600 1.80 compare (1) 128K N/A 15.0 #146 13.1 #129 ERNIE 4.5 300B A47B 0.280 1.10 compare (1) 123K 12K 15.0 #145 14.5 #113 Ministral 3 8B 0.150 0.150 compare (1) 262K N/A 14.8 #147 10.0 #153 Qwen3 32B 0.080 0.240 compare (11) 131K 16K 14.5 #148 13.8 #122 Llama 3.3 70B Instruct 0.100 0.300 compare (16) 131K 120K 14.5 #150 10.7 #150 Gemini 2.0 Flash Lite 0.075 0.300 compare (4) 1.0M 8K 14.5 #149 N/A Qwen3 VL 8B Instruct 0.080 0.200 compare (4) 131K 33K 14.3 #151 7.3 #163 Qwen3 4B 0.080 0.200 compare (3) 131K 8K 14.2 #152 9.5 #156 Claude Sonnet 3.5 3.00 15.00 compare (6) 1.0M 8K 14.2 #153 26.0 #58 GPT-4o 2.50 10.00 compare (7) 131K 16K 14.1 #154 16.6 #103 Pixtral Large 2.00 6.00 compare (4) 131K 4K 14.0 #155 N/A Olmo 3.1 32B Think N/A N/A compare (1) 66K N/A 13.9 #156 9.8 #155 Grok 2 2.00 10.00 compare (2) 131K 4K 13.9 #157 N/A GPT-5 Nano 0.050 0.400 compare (7) 400K 128K 13.8 #158 14.2 #119 GPT-4 Turbo 10.00 30.00 compare (4) 128K 4K 13.7 #159 21.5 #81 Nova Pro 0.800 3.20 compare (4) 300K 10K 13.5 #160 11.0 #143 Llama 4 Scout 0.080 0.300 compare (3) 328K 16K 13.5 #162 6.7 #168 Command A 1.56 1.56 compare (3) 256K 8K 13.5 #161 9.9 #154 NVIDIA Llama 3.1 Nemotron 70B Instruct 0.120 0.300 compare (3) 131K 16K 13.4 #163 10.8 #147 Grok Beta 5.00 15.00 compare (1) 131K N/A 13.3 #164 N/A Qwen2.5 32B Instruct 0.060 0.200 compare (3) 131K 8K 13.2 #165 N/A Nemotron Nano 2 9B 0.040 0.160 compare (5) 131K 8K 13.2 #166 7.5 #161 GPT-4.1 Nano 0.100 0.400 compare (5) 1.0M 33K 13.0 #167 11.2 #138 Qwen2.5 Coder 32B Instruct 0.050 0.100 compare (7) 131K 8K 12.9 #168 N/A Qwen3 14B 0.060 0.200 compare (6) 131K 16K 12.8 #169 12.4 #133 GPT-4 30.00 60.00 compare (4) 33K 8K 12.8 #170 13.1 #130 Nova Lite 0.060 0.240 compare (4) 300K 10K 12.7 #171 5.1 #173 GLM-4.5 V 0.600 1.20 compare (5) 131K 32K 12.7 #173 10.8 #148 Gemini 2.5 Flash Lite 0.075 0.300 compare (6) 1.0M 66K 12.7 #172 7.4 #162 GPT-4o Mini 0.150 0.600 compare (7) 131K 16K 12.6 #174 N/A Qwen3 4B Instruct 0.200 0.200 compare (1) 262K 33K 12.5 #176 9.1 #157 Qwen3 30B A3B Instruct 0.090 0.300 compare (3) 262K 33K 12.5 #175 11.0 #142 Llama 3.1 70B Instruct 0.120 0.300 compare (12) 131K 8K 12.5 #177 10.9 #145 Gemini 2.0 Flash 0.100 0.400 compare (5) 1.0M 8K 12.3 #180 13.6 #125 DeepSeek V2.5 1.20 1.20 compare (1) 33K N/A 12.3 #179 N/A Claude Haiku 3 0.250 1.25 compare (5) 200K 4K 12.3 #178 6.7 #167 Olmo 3.1 32B Instruct 0.200 0.600 compare (1) 66K N/A 12.2 #181 5.6 #172 Olmo 3 32B Think 0.150 0.500 compare (1) 66K 4K 12.1 #182 10.5 #152 Mistral Saba 0.200 0.600 compare (1) 33K N/A 12.1 #184 N/A DeepSeek R1 Distill Llama 8B 0.050 0.050 compare (2) 131K 16K 12.1 #183 N/A Reka Flash 0.900 0.900 compare (1) 100K 8K 12.0 #186 N/A Qwen Turbo 0.033 0.130 compare (2) 1.0M 16K 12.0 #185 N/A Llama 3.2 90B Instruct 0.720 0.720 compare (1) 128K 4K 11.9 #187 N/A Llama 3.1 8B Instruct 0.020 0.040 compare (15) 200K 128K 11.8 #188 4.9 #174 Qwen2 72B Instruct 0.900 0.900 compare (1) 33K N/A 11.7 #189 N/A Ministral 3 3B 0.100 0.100 compare (1) 131K N/A 11.2 #190 4.8 #175 Jamba 1.7 Large 2.00 8.00 compare (2) 256K 4K 10.9 #191 7.8 #159 Qwen3 Omni 30B A3B Instruct 0.250 0.970 compare (1) 66K 16K 10.7 #193 7.2 #164 Jamba 1.5 Large 2.00 2.80 compare (4) 256K 8K 10.7 #192 N/A Qwen3 8B 0.050 0.200 compare (3) 131K 8K 10.6 #195 7.1 #165 Jamba 1.6 Large 2.00 8.00 compare (1) 256K N/A 10.6 #194 N/A Hermes 3 Llama 3.1 70B 0.120 0.300 compare (3) 131K N/A 10.6 #196 N/A LFM 2 24B A2B 0.030 0.120 compare (1) 33K N/A 10.5 #197 3.6 #179 Nova Micro 0.035 0.140 compare (4) 128K 10K 10.3 #198 4.1 #177 Claude Sonnet 3 3.00 15.00 compare (2) 200K 4K 10.3 #199 N/A Nemotron Nano 2 12B VL 0.100 0.100 compare (3) 131K 4K 10.1 #201 5.9 #171 Nemotron 2 Nano 12B VL N/A N/A compare (3) 131K N/A 10.1 #200 5.9 #170 Qwen2.5 Coder 7B Instruct 0.010 0.030 compare (3) 131K 8K 10.0 #202 N/A Mistral Large 0.500 1.50 compare (7) 262K 16K 9.9 #203 N/A Mixtral 8x22B Instruct 1.20 1.20 compare (4) 66K 2K 9.8 #204 N/A Llama 3.2 3B Instruct 0.015 0.020 compare (9) 131K 32K 9.7 #206 N/A Llama 2 7B Chat 0.050 0.200 compare (3) 4K 4K 9.7 #205 N/A Reka Flash 3 0.100 0.200 compare (1) 66K N/A 9.5 #207 8.9 #158 DeepSeek R1 Distill Qwen 1.5B 0.100 0.100 compare (2) 131K N/A 9.1 #209 N/A Claude 2.0 8.00 24.00 compare (1) 100K 8K 9.1 #208 12.9 #131 Mistral Small 0.100 0.300 compare (6) 262K 8K 9.0 #211 N/A Mistral Medium 0.400 2.00 compare (4) 131K 64K 9.0 #210 N/A GPT-3.5 Turbo 0.500 1.50 compare (5) 16K 4K 9.0 #212 10.7 #151 Llama 3 70B Instruct 0.120 0.300 compare (7) 131K 8K 8.9 #213 6.8 #166 LFM 40B 0.100 0.200 compare (1) 131K N/A 8.8 #215 N/A Gemma 3 12B Instruct 0.150 0.500 compare (1) 128K 32K 8.8 #214 6.3 #169 Llama 3.2 11B Instruct 0.160 0.160 compare (1) 128K 4K 8.7 #216 4.3 #176 Phi-4 0.065 0.140 compare (3) 16K 16K 8.4 #219 3.6 #180 Llama 2 70B Chat 0.500 0.900 compare (6) 4K 4K 8.4 #218 N/A Llama 2 13B Chat 0.100 0.200 compare (3) 4K 4K 8.4 #217 N/A Command R+ 4 3.00 15.00 compare (1) 128K 4K 8.3 #220 N/A Jamba 1.7 Mini 0.200 0.400 compare (1) 256K N/A 8.1 #221 3.1 #182 LFM 2.2 6B N/A N/A compare (1) 33K N/A 8.0 #223 1.4 #185 Jamba 1.5 Mini 0.200 0.200 compare (4) 256K 8K 8.0 #222 N/A Jamba 1.6 Mini 0.200 0.400 compare (1) 256K N/A 7.9 #224 N/A Mixtral 8x7B Instruct 0.070 0.280 compare (9) 33K 16K 7.7 #225 N/A Mistral 7B Instruct 0.010 0.100 compare (8) 127K 16K 7.4 #227 N/A Command R 3 0.500 1.50 compare (1) 128K 4K 7.4 #226 N/A LFM 2 8B A1B N/A N/A compare (1) 33K N/A 7.0 #229 2.3 #183 Granite 3.3 8B 0.030 0.200 compare (2) 8K 8K 7.0 #228 3.4 #181 Qwen3 1.7B 0.100 0.100 compare (2) 131K 8K 6.8 #230 1.4 #184 Llama 3 8B Instruct 0.030 0.040 compare (7) 32K 8K 6.4 #231 4.0 #178 Llama 3.2 1B Instruct 0.027 0.080 compare (5) 128K 16K 6.3 #232 0.6 #187 Qwen3 0.6B 0.100 0.100 compare (2) 41K 8K 5.7 #233 0.9 #186 Aion-1.0 N/A N/A compare (1) 131K 33K N/A N/A Aion-1.0 4.00 8.00 compare (1) 131K 33K N/A N/A Aion-1.0-Mini N/A N/A compare (1) 131K 33K N/A N/A Aion-1.0-Mini 0.700 1.40 compare (1) 131K 33K N/A N/A Aion-2.0 N/A N/A compare (1) 131K 33K N/A N/A Aion-2.0 0.800 1.60 compare (1) 131K 33K N/A N/A Aion-RP 1.0 (8B) 0.800 1.60 compare (1) 33K N/A N/A N/A Aion-RP 1.0 (8B) N/A N/A compare (1) 33K N/A N/A N/A Allam 1 13B Instruct 1.80 1.80 compare (1) 8K 8K N/A N/A Arctic 1.68 1.68 compare (1) 4K N/A N/A N/A AutoGLM 9B Phone Multilingual N/A N/A compare (1) 66K N/A N/A N/A AutoGLM Phone 9B Multilingual 0.035 0.138 compare (1) 66K N/A N/A N/A Aya Expanse 0.500 1.50 compare (1) 128K 4K N/A N/A Aya Expanse 0.500 1.50 compare (1) 8K 4K N/A N/A Babbage 2 0.400 0.400 compare (1) 16K 16K N/A N/A Baichuan M2 32B 0.070 0.070 compare (1) 131K N/A N/A N/A Bison 1 Chat 0.125 0.125 compare (1) 8K 4K N/A N/A Bison 1 Text 0.125 0.125 compare (1) 8K 1K N/A N/A Bison Chat 0.125 0.125 compare (1) 8K 4K N/A N/A Bison Text 0.125 0.125 compare (1) 8K 1K N/A N/A Bison Text Safety Off 0.125 0.125 compare (1) 8K 1K N/A N/A Bison Text Safety Recitation Off 0.125 0.125 compare (1) 8K 1K N/A N/A Bytedance Seed 1.8 0.250 2.00 compare (1) 256K 64K N/A N/A Capybara 1.9 7B 0.200 0.200 compare (1) 33K N/A N/A N/A Chronos Hermes 2 13B 0.200 0.200 compare (1) 4K 4K N/A N/A Claude 1 8.00 24.00 compare (1) 100K 8K N/A N/A Claude 1 Instant 2.23 7.55 compare (1) 100K 8K N/A N/A Claude Opus 4.7 5.00 25.00 compare (7) 1.0M 128K N/A N/A Claude Sonnet 4.1 3.00 15.00 compare (1) 200K 64K N/A N/A Code Llama 13B 0.200 0.200 compare (1) 16K 16K N/A N/A Code Llama 13B Instruct 0.200 0.200 compare (1) 16K 16K N/A N/A Code Llama 13B Python 0.200 0.200 compare (1) 16K 16K N/A N/A Code Llama 34B 0.900 0.900 compare (1) 16K 16K N/A N/A Code Llama 34B Instruct 0.350 0.900 compare (2) 16K 16K N/A N/A Code Llama 34B Python 0.900 0.900 compare (1) 16K 16K N/A N/A Code Llama 70B 0.900 0.900 compare (1) 4K 4K N/A N/A Code Llama 70B Instruct 0.700 0.900 compare (2) 16K 16K N/A N/A Code Llama 70B Python 0.900 0.900 compare (1) 4K 4K N/A N/A Code Llama 7B 0.200 0.200 compare (1) 16K 16K N/A N/A Code Llama 7B Instruct 0.200 0.200 compare (2) 16K 16K N/A N/A Code Llama 7B Python 0.200 0.200 compare (1) 16K 16K N/A N/A CodeGemma 2B 0.100 0.100 compare (1) 8K 8K N/A N/A CodeGemma 7B 0.200 0.200 compare (1) 8K 8K N/A N/A CodeLLaMa 7B Instruct Solidity 0.800 1.20 compare (1) 4K 4K N/A N/A CodeQwen 1.5 7B N/A N/A compare (1) 66K N/A N/A N/A Coder Large 0.500 0.800 compare (1) 33K N/A N/A N/A Codestral 0.200 0.600 compare (4) 256K 8K N/A N/A Codestral 2 0.300 0.900 compare (1) 128K N/A N/A N/A Codestral Mamba 7B 0.250 0.250 compare (1) 256K N/A N/A N/A Codex Mini 1.50 6.00 compare (2) 200K 100K N/A N/A Cogito 2 671B 1.20 1.20 compare (1) 164K N/A N/A N/A Cogito 2 671B P1 N/A N/A compare (1) 164K N/A N/A N/A Cogito Llama 1 1.3B Preview 0.100 0.100 compare (1) 131K N/A N/A N/A Cogito Llama 1 1.8B Preview 0.200 0.200 compare (1) 131K N/A N/A N/A Cogito Llama 1 70B Preview 0.900 0.900 compare (1) 131K N/A N/A N/A Cogito Qwen 1 14B Preview 0.200 0.200 compare (1) 131K N/A N/A N/A Cogito Qwen 1 32B Preview 0.900 0.900 compare (1) 131K N/A N/A N/A Cogito v2.1 671B 1.25 1.25 compare (1) 128K N/A N/A N/A Command 1.00 1.56 compare (2) 128K 4K N/A N/A Command 14 Light Text 0.300 0.600 compare (1) 4K 4K N/A N/A Command 14 Text 1.00 2.00 compare (1) 4K 4K N/A N/A Command A 2.50 10.00 compare (1) 256K 8K N/A N/A Command A Reasoning 1.56 1.56 compare (1) 256K 32K N/A N/A Command A Translate 0.090 0.090 compare (1) 256K 8K N/A N/A Command A Vision 1.56 1.56 compare (1) 128K 8K N/A N/A Command Light 0.300 0.600 compare (1) 4K 4K N/A N/A Command Nightly 1.00 2.00 compare (1) 4K 4K N/A N/A Command Plus 1.56 1.56 compare (1) 128K 4K N/A N/A Command R 0.150 0.600 compare (3) 128K 4K N/A N/A Command R 8 0.150 0.150 compare (3) 128K 4K N/A N/A Command R+ 2.50 10.00 compare (4) 128K 4K N/A N/A Command R+ 8 1.56 1.56 compare (3) 128K 4K N/A N/A Command R7B (12-2024) 0.037 0.150 compare (2) 128K 4K N/A N/A Computer Use Preview 3.00 12.00 compare (2) 8K 1K N/A N/A Cydonia 24B V4.1 0.300 0.500 compare (1) 131K N/A N/A N/A DataForSEO Search N/A N/A compare (1) N/A N/A N/A N/A Davinci 2 2.00 2.00 compare (1) 16K 16K N/A N/A DBRX Instruct 1.20 1.20 compare (1) 33K N/A N/A N/A DeepSeek Coder 0.140 0.280 compare (1) 128K 4K N/A N/A DeepSeek Coder 1.3B Base 0.100 0.100 compare (1) 16K 16K N/A N/A DeepSeek Coder 33B Instruct 0.900 0.900 compare (1) 16K 16K N/A N/A DeepSeek Coder 7B Base 0.200 0.200 compare (1) 4K 4K N/A N/A DeepSeek Coder 7B Base V1.5 0.200 0.200 compare (1) 4K 4K N/A N/A DeepSeek Coder 7B Instruct V1.5 0.200 0.200 compare (1) 4K 4K N/A N/A DeepSeek Coder V2 Instruct 1.20 1.20 compare (1) 66K 8K N/A N/A DeepSeek Coder V2 Lite Base 0.500 0.500 compare (1) 164K 8K N/A N/A DeepSeek Coder V2 Lite Instruct 0.500 0.500 compare (1) 164K 8K N/A N/A DeepSeek Llama3.3 70B 0.200 0.600 compare (1) 131K N/A N/A N/A DeepSeek Prover V2 1.20 1.20 compare (1) 164K N/A N/A N/A DeepSeek Prover V2 671B 0.700 2.50 compare (1) 160K N/A N/A N/A DeepSeek R1 0528 0.200 0.600 compare (8) 164K 33K N/A N/A DeepSeek R1 0528 Distill Qwen3 8B 0.200 0.200 compare (1) 131K N/A N/A N/A DeepSeek R1 0528 Qwen3 8B 0.060 0.090 compare (1) 128K 32K N/A N/A DeepSeek R1 528 Qwen3 8B N/A N/A compare (1) 128K 32K N/A N/A DeepSeek R1 528B N/A N/A compare (7) 164K 33K N/A N/A DeepSeek R1 528B Turbo N/A N/A compare (1) 33K N/A N/A N/A DeepSeek R1 671B 0.800 0.800 compare (1) 131K N/A N/A N/A DeepSeek R1 Basic 0.550 2.19 compare (1) 128K 20K N/A N/A DeepSeek R1 Distill Qwen 7B 0.072 0.144 compare (3) 131K 16K N/A N/A DeepSeek R1 Distill Qwen3 8B N/A N/A compare (1) 131K N/A N/A N/A DeepSeek R1 Turbo 0.700 2.50 compare (2) 64K 16K N/A N/A DeepSeek R1T2 Chimera 0.300 1.10 compare (1) 164K N/A N/A N/A DeepSeek V2 Lite Chat 0.500 0.500 compare (1) 164K N/A N/A N/A DeepSeek V3 Turbo 0.400 1.30 compare (1) 64K 16K N/A N/A DeepSeek V3.1 Nex N1 N/A N/A compare (1) 131K N/A N/A N/A DeepSeek V3.2 Exp 0.270 0.410 compare (3) 164K 66K N/A N/A DeepSeek V3.2 Thinking 0.280 0.420 compare (1) 128K 64K N/A N/A Devstral 0.400 2.00 compare (1) 256K N/A N/A N/A Devstral 2 0.400 2.00 compare (2) 262K 66K N/A N/A Devstral 2 123B 0.400 2.00 compare (1) 256K 8K N/A N/A Devstral Medium 1.0 0.400 2.00 compare (1) 128K N/A N/A N/A Devstral Small 1.1 0.100 0.300 compare (1) 128K N/A N/A N/A Dobby Llama 3.1 Mini 8B Unhinged Plus N/A N/A compare (1) 131K N/A N/A N/A Dobby Unhinged Llama 3.3 70B N/A N/A compare (1) 131K N/A N/A N/A Dolphin 0.500 0.500 compare (1) 16K 16K N/A N/A Dolphin 2.6 Mixtral 8x7B N/A N/A compare (1) 33K N/A N/A N/A Dolphin 2.9.2 Qwen2 72B N/A N/A compare (1) 131K N/A N/A N/A DuckDuckGo Search N/A N/A compare (1) N/A N/A N/A N/A ERNIE 4.5 21B A3B 0.070 0.280 compare (2) 120K 8K N/A N/A ERNIE 4.5 21B A3B PT 0.100 0.100 compare (1) 4K 4K N/A N/A ERNIE 4.5 21B A3B Thinking 0.070 0.280 compare (2) 131K 66K N/A N/A ERNIE 4.5 28B A3B VL Thinking 0.390 0.390 compare (1) 131K 66K N/A N/A ERNIE 4.5 300B A47B Paddle 0.280 1.10 compare (1) 123K 12K N/A N/A ERNIE 4.5 300B A47B PT 0.100 0.100 compare (1) 4K 4K N/A N/A ERNIE 4.5 VL 28B A3B 0.140 0.560 compare (2) 30K 8K N/A N/A ERNIE 4.5 VL 424B A47B 0.420 1.25 compare (2) 123K 16K N/A N/A FireFunction V1 N/A N/A compare (1) 33K N/A N/A N/A FireFunction V2 N/A N/A compare (1) 8K 8K N/A N/A FireLLaVA 13B N/A N/A compare (1) 4K 4K N/A N/A Flan-T5 3B XL N/A N/A compare (1) 8K 8K N/A N/A Flan-T5 XL 3B 0.600 0.600 compare (1) 8K 8K N/A N/A FLUX.1 Dev 0.100 0.100 compare (1) 4K 4K N/A N/A FLUX.1 Dev ControlNet Union 0.0010 0.0010 compare (1) 4K 4K N/A N/A Gemini 2.5 Computer Use Preview 1.25 10.00 compare (2) 128K 64K N/A N/A Gemini 2.5 Flash Image 0.300 2.50 compare (4) 66K 66K N/A N/A Gemini 2.5 Flash Live Native Audio N/A N/A compare (2) 128K 64K N/A N/A Gemini 2.5 Flash Live Preview Native Audio 0.300 2.00 compare (2) 1.0M 66K N/A N/A Gemini 2.5 Flash Native Audio 0.300 2.50 compare (1) 1.0M 8K N/A N/A Gemini 2.5 Flash Native Audio Preview 0.300 2.50 compare (1) 1.0M 8K N/A N/A Gemini 2.5 Pro Preview 1.25 10.00 compare (2) 1.0M 66K N/A N/A Gemini 2.5 Pro TTS 1.00 N/A compare (1) N/A N/A N/A N/A Gemini 3 Flash Preview 0.500 3.00 compare (4) 1.0M 66K N/A N/A Gemini 3 Pro Image Preview 2.00 12.00 compare (3) 66K 33K N/A N/A Gemini 3 Pro Preview 2.00 12.00 compare (6) 1.0M 66K N/A N/A Gemini 3.1 Flash Image Preview 0.250 1.50 compare (4) 131K 33K N/A N/A Gemini 3.1 Flash Live Preview 0.750 4.50 compare (1) 131K 66K N/A N/A Gemini 3.1 Flash TTS Preview 1.00 N/A compare (1) 8K 16K N/A N/A Gemini 3.1 Pro Preview Custom Tools N/A N/A compare (3) 1.0M 66K N/A N/A Gemini Embedding 001 0.150 N/A compare (3) 2K 128 N/A N/A Gemini Embedding 2 Preview 0.200 N/A compare (2) 8K 128 N/A N/A Gemini Exp 0.300 2.50 compare (1) 2.1M 66K N/A N/A Gemini Flash 0.300 2.50 compare (1) 1.0M 66K N/A N/A Gemini Flash Lite 0.100 0.400 compare (1) 1.0M 66K N/A N/A Gemini Pro 1.25 10.00 compare (1) 1.0M 66K N/A N/A Gemini Robotics-ER 1.5 Preview 0.300 2.50 compare (2) 1.0M 66K N/A N/A Gemma 2 27B N/A N/A compare (2) 8K 8K N/A N/A Gemma 2 27B Instruct 0.350 0.650 compare (2) 8K 8K N/A N/A Gemma 2 9B 0.200 0.200 compare (1) 8K 8K N/A N/A Gemma 2B IT 0.100 0.100 compare (1) 8K 8K N/A N/A Gemma 3 12B IT 0.040 0.100 compare (4) 131K 8K N/A N/A Gemma 3 27B IT 0.060 0.160 compare (6) 131K 16K N/A N/A Gemma 3 4B IT 0.040 0.080 compare (3) 131K 8K N/A N/A Gemma 3n 4B 0.020 0.040 compare (1) 33K 2K N/A N/A Gemma 3n 4B N/A N/A compare (2) 33K 2K N/A N/A Gemma 4 26B A4B Instruct 0.080 0.350 compare (2) 262K 131K N/A N/A Gemma 4 31B Instruct 0.130 0.380 compare (2) 262K 131K N/A N/A Gemma 4 31B IT N/A N/A compare (3) 262K 131K N/A N/A Gemma 7B 0.200 0.200 compare (2) 8K 8K N/A N/A Gemma 7B Instruct 0.050 0.080 compare (2) 8K 8K N/A N/A Gemma2 9B IT 0.200 0.200 compare (2) 8K 8K N/A N/A GLM 4 32B 0.100 0.100 compare (1) 128K N/A N/A N/A GLM 4.7 FlashX 0.060 0.400 compare (1) 200K 128K N/A N/A GLM-4 32B 128K 0.100 0.100 compare (1) 128K 32K N/A N/A GLM-4.5 Air FP8 0.200 1.10 compare (1) 128K N/A N/A N/A GLM-4.5 AirX 1.10 4.50 compare (1) 128K 32K N/A N/A GLM-4.5 X 2.20 8.90 compare (1) 128K 32K N/A N/A GLM-4.7 FP8 0.400 2.00 compare (1) 203K 16K N/A N/A GLM-4.7 MaaS N/A N/A compare (1) 200K 128K N/A N/A GLM-5 Code 1.20 5.00 compare (1) 200K 128K N/A N/A GLM-5 MaaS 1.00 3.20 compare (1) 200K 128K N/A N/A Goliath 120B 3.75 7.50 compare (1) 6K 1K N/A N/A GPT 5.1 Thinking 1.25 10.00 compare (1) 400K 128K N/A N/A GPT Audio 2.50 10.00 compare (3) 128K 16K N/A N/A GPT Audio 1.5 2.50 10.00 compare (2) 128K 16K N/A N/A GPT Audio Mini 0.600 2.40 compare (3) 128K 16K N/A N/A GPT OSS 120B MaaS N/A N/A compare (1) 131K 33K N/A N/A GPT OSS 120B Safeguard 0.150 0.600 compare (2) 131K 66K N/A N/A GPT OSS 20B MaaS N/A N/A compare (1) 131K 33K N/A N/A GPT OSS 20B Safeguard 0.070 0.200 compare (5) 131K 66K N/A N/A GPT Realtime 4.00 16.00 compare (2) 32K 4K N/A N/A GPT Realtime 1.5 4.00 16.00 compare (2) 32K 4K N/A N/A GPT Realtime Mini 0.600 2.40 compare (2) 128K 4K N/A N/A GPT-3.5 Turbo 16k 3.00 4.00 compare (3) 16K 4K N/A N/A GPT-3.5 Turbo Instruct 1.50 2.00 compare (4) 8K 4K N/A N/A GPT-4 30.00 60.00 compare (2) 8K 4K N/A N/A GPT-4 0613 30.00 60.00 compare (3) 33K 4K N/A N/A GPT-4 32k 30.00 120.00 compare (1) 33K 4K N/A N/A GPT-4 Turbo 10.00 30.00 compare (3) 128K 4K N/A N/A GPT-4 Turbo Vision 10.00 30.00 compare (1) 128K 4K N/A N/A GPT-4.5 Preview 75.00 150.00 compare (2) 128K 16K N/A N/A GPT-4o (extended) 6.00 18.00 compare (1) 128K 64K N/A N/A GPT-4o Audio N/A N/A compare (2) 128K 16K N/A N/A GPT-4o Audio 2.50 10.00 compare (3) 128K 16K N/A N/A GPT-4o mini Audio 0.150 0.600 compare (2) 128K 16K N/A N/A GPT-4o Mini Audio N/A N/A compare (2) 128K 16K N/A N/A GPT-4o mini Realtime 0.150 0.600 compare (2) 128K 4K N/A N/A GPT-4o Mini Realtime N/A N/A compare (2) 128K 4K N/A N/A GPT-4o Mini Search Preview 0.150 0.600 compare (3) 128K 16K N/A N/A GPT-4o Realtime N/A N/A compare (1) 128K 4K N/A N/A GPT-4o Realtime Preview 2.50 10.00 compare (2) 128K 4K N/A N/A GPT-4o Search Preview 2.50 10.00 compare (2) 128K 16K N/A N/A GPT-4o Search Preview N/A N/A compare (2) 128K 16K N/A N/A GPT-5 Chat 1.25 10.00 compare (4) 128K 16K N/A N/A GPT-5 Image 10.00 10.00 compare (1) 400K 128K N/A N/A GPT-5 Image Mini 2.50 2.00 compare (1) 400K 128K N/A N/A GPT-5 Pro 15.00 120.00 compare (4) 400K 272K N/A N/A GPT-5 Search API 1.25 10.00 compare (1) 272K 128K N/A N/A GPT-5.1 Chat 1.25 10.00 compare (3) 128K 16K N/A N/A GPT-5.1 Codex Max 1.25 10.00 compare (5) 400K 128K N/A N/A GPT-5.1 Instant 1.25 10.00 compare (1) 128K 16K N/A N/A GPT-5.2 Chat 1.75 14.00 compare (4) 128K 32K N/A N/A GPT-5.2 Pro 21.00 168.00 compare (4) 400K 128K N/A N/A GPT-5.3 Chat 1.75 14.00 compare (4) 128K 64K N/A N/A GPT-5.4 3.5 N/A N/A compare (2) 1.1M 128K N/A N/A GPT-5.4 Pro 30.00 180.00 compare (4) 1.1M 128K N/A N/A GPT-5.4 Pro 3.5 N/A N/A compare (2) 1.1M 128K N/A N/A Granite 2 13B Chat 0.600 0.600 compare (1) 8K 8K N/A N/A Granite 2 13B Instruct 0.600 0.600 compare (1) 8K 8K N/A N/A Granite 3 8B Instruct 0.200 0.200 compare (1) 8K 1K N/A N/A Granite 4 Small 0.060 0.250 compare (1) 20K N/A N/A N/A Granite 4.0 Micro H 0.017 0.110 compare (1) 131K N/A N/A N/A Granite Guardian 3.2 2B 0.100 0.100 compare (1) 8K 8K N/A N/A Granite Guardian 3.3 8B 0.200 0.200 compare (1) 8K 8K N/A N/A Granite TTM 2 0.380 0.380 compare (1) 512 512 N/A N/A Granite TTM 2 1024 96 N/A N/A compare (1) 512 512 N/A N/A Granite TTM 2 1536 96 N/A N/A compare (1) 512 512 N/A N/A Granite TTM 2 512 96 N/A N/A compare (1) 512 512 N/A N/A Granite Vision 3.2 2B 0.100 0.100 compare (1) 8K 8K N/A N/A Grok 2 Vision 2.00 10.00 compare (2) 33K N/A N/A N/A Grok 3 Beta 3.00 15.00 compare (2) 131K N/A N/A N/A Grok 3 Fast Beta 3.00 15.00 compare (3) 131K N/A N/A N/A Grok 3 Fast Beta 3.00 15.00 compare (1) 131K N/A N/A N/A Grok 3 Mini Beta 0.300 0.500 compare (2) 131K N/A N/A N/A Grok 3 Mini Fast Beta 0.300 0.500 compare (3) 131K N/A N/A N/A Grok 3 Mini Fast Beta 0.300 0.500 compare (1) 131K N/A N/A N/A Grok 4 20 Reasoning N/A N/A compare (2) 2.0M N/A N/A N/A Grok 4 Fast Non-Reasoning 0.200 0.500 compare (3) 2.0M 256K N/A N/A Grok 4 Multi-Agent 2.00 6.00 compare (1) 2.0M N/A N/A N/A Grok 4 Reasoning 2.00 6.00 compare (2) 2.0M N/A N/A N/A Grok 4.1 Fast Non-Reasoning 0.200 0.500 compare (4) 2.0M 30K N/A N/A Grok 4.20 Multi Agent Beta 2.00 6.00 compare (1) 2.0M N/A N/A N/A Grok 4.20 Multi-Agent 2.00 6.00 compare (4) 2.0M N/A N/A N/A Grok Code Fast 0.200 1.50 compare (1) 256K N/A N/A N/A Grok Vision Beta 5.00 15.00 compare (1) 8K 8K N/A N/A Hermes 13B N/A N/A compare (1) 4K 4K N/A N/A Hermes 2 34B N/A N/A compare (1) 4K 4K N/A N/A Hermes 2 8x7B DPO N/A N/A compare (1) 33K N/A N/A N/A Hermes 2 Mixtral 8x7B DPO 0.500 0.500 compare (1) 33K N/A N/A N/A Hermes 2 Pro 8B N/A N/A compare (2) 8K 8K N/A N/A Hermes 2 Pro 8B Llama 3 0.140 0.140 compare (2) 8K 8K N/A N/A Hermes 2 Yi 34B 0.900 0.900 compare (1) 4K 4K N/A N/A Hermes 3 405B 0.800 0.800 compare (1) 131K N/A N/A N/A Hermes 3 405B Instruct 1.00 1.00 compare (3) 131K 16K N/A N/A Hermes 3 70B 0.120 0.300 compare (1) 131K N/A N/A N/A Hermes 3 8B 0.025 0.040 compare (1) 131K N/A N/A N/A Hermes 4 405B 1.00 3.00 compare (1) 131K N/A N/A N/A Hermes 4 70B 0.130 0.400 compare (1) 131K N/A N/A N/A Hermes 70B N/A N/A compare (1) 4K 4K N/A N/A Hermes 7B N/A N/A compare (1) 4K 4K N/A N/A Hermes Llama2 13B 0.200 0.200 compare (1) 4K 4K N/A N/A Hermes Llama2 70B 0.900 0.900 compare (1) 4K 4K N/A N/A Hermes Llama2 7B 0.200 0.200 compare (1) 4K 4K N/A N/A Hunyuan A13B Instruct N/A N/A compare (1) 131K N/A N/A N/A Hunyuan A13B Instruct 0.140 0.570 compare (1) 131K N/A N/A N/A Inflection 3 Pi 2.50 10.00 compare (1) 8K 1K N/A N/A Inflection 3 Productivity 2.50 10.00 compare (1) 8K 1K N/A N/A InternVL3 38B N/A N/A compare (1) 16K 16K N/A N/A InternVL3 38B 0.900 0.900 compare (1) 16K 16K N/A N/A InternVL3 78B N/A N/A compare (1) 16K 16K N/A N/A InternVL3 78B 0.900 0.900 compare (1) 16K 16K N/A N/A InternVL3 8B N/A N/A compare (1) 16K 16K N/A N/A InternVL3 8B 0.200 0.200 compare (1) 16K 16K N/A N/A Jais 13B Chat 0.500 2.00 compare (1) 8K 8K N/A N/A Jais 30B Chat 3.20 9.71 compare (1) 8K 8K N/A N/A Jais 30B Chat N/A N/A compare (1) 8K 8K N/A N/A Jamba 1 Instruct N/A N/A compare (1) 70K 4K N/A N/A Jamba 1.5 0.200 0.400 compare (2) 256K N/A N/A N/A Jamba Instruct 0.500 0.700 compare (3) 256K 8K N/A N/A Jurassic-2 1 Mid 12.50 12.50 compare (1) 8K 8K N/A N/A Jurassic-2 1 Ultra 18.80 18.80 compare (1) 8K 8K N/A N/A Jurassic-2 Light 3.00 3.00 compare (1) 8K 8K N/A N/A Jurassic-2 Mid 10.00 10.00 compare (1) 8K 8K N/A N/A Jurassic-2 Ultra 15.00 15.00 compare (1) 8K 8K N/A N/A Kimi 2.00 5.00 compare (1) 131K N/A N/A N/A Kimi 128K 2.00 5.00 compare (1) 131K N/A N/A N/A Kimi 32K 1.00 3.00 compare (1) 33K N/A N/A N/A Kimi 8K 0.200 2.00 compare (1) 8K 8K N/A N/A Kimi K2 Instruct 0.500 2.00 compare (6) 262K 33K N/A N/A Kimi K2 Preview 0.600 2.50 compare (1) 262K N/A N/A N/A Kimi K2 Thinking Turbo 1.15 8.00 compare (2) 262K N/A N/A N/A Kimi K2 Turbo 1.15 8.00 compare (1) 256K 16K N/A N/A Kimi K2 Turbo Preview 1.15 8.00 compare (1) 262K N/A N/A N/A Kimi Thinking N/A N/A compare (1) 131K N/A N/A N/A Kimi Thinking Preview 0.600 2.50 compare (1) 131K N/A N/A N/A KwaiPilot KAT 32B Dev 0.900 0.900 compare (1) 131K N/A N/A N/A KwaiPilot KAT 72B Dev N/A N/A compare (1) 131K N/A N/A N/A KwaiPilot KAT 72B Dev Exp 0.900 0.900 compare (1) 131K N/A N/A N/A KwaiPilot KAT Coder 0.900 0.900 compare (1) 262K N/A N/A N/A KwaiPilot KAT Pro Coder 0.300 1.20 compare (1) 256K 128K N/A N/A L3 70B Euryale V2.1 1.48 1.48 compare (1) 8K 8K N/A N/A L3 8B Stheno V3.2 0.050 0.050 compare (1) 8K N/A N/A N/A LFM 7B 0.025 0.040 compare (1) 131K N/A N/A N/A Llama 2 13B 0.100 0.200 compare (2) 4K 4K N/A N/A Llama 2 70B 0.100 0.100 compare (2) 4K 4K N/A N/A Llama 2 7B 0.050 0.200 compare (2) 4K 4K N/A N/A Llama 3 70B 0.590 0.790 compare (3) 8K 8K N/A N/A Llama 3 8B 0.050 0.080 compare (4) 8K 8K N/A N/A Llama 3 8B Lunaris N/A N/A compare (1) 8K N/A N/A N/A Llama 3 8B Lunaris 1 N/A N/A compare (1) 8K 8K N/A N/A Llama 3 Euryale 70B v2.1 N/A N/A compare (1) 8K 8K N/A N/A Llama 3 Euryale 70B v2.1 1.48 1.48 compare (1) 8K 8K N/A N/A Llama 3 Lunaris 1 8B Turbo 0.040 0.050 compare (1) 8K 8K N/A N/A Llama 3 Lunaris 8B 0.040 0.050 compare (2) 8K 8K N/A N/A Llama 3.1 405B 2.40 2.40 compare (1) 128K 8K N/A N/A Llama 3.1 405B Instruct Long 0.100 0.100 compare (1) 4K 4K N/A N/A Llama 3.1 70B 0.600 0.600 compare (3) 128K 8K N/A N/A Llama 3.1 70B Hanami x1 N/A N/A compare (1) 16K N/A N/A N/A Llama 3.1 70B Hanami x1 3.00 3.00 compare (1) 16K N/A N/A N/A Llama 3.1 70B Instruct Turbo 0.100 0.280 compare (2) 131K N/A N/A N/A Llama 3.1 8B 0.100 0.100 compare (4) 131K 8K N/A N/A Llama 3.1 8B Instant 0.050 0.080 compare (1) 128K 8K N/A N/A Llama 3.1 8B Instruct Turbo 0.020 0.030 compare (2) 131K N/A N/A N/A Llama 3.1 Euryale 2.2 70B 0.650 0.750 compare (2) 131K 8K N/A N/A Llama 3.1 Euryale 70B v2.2 N/A N/A compare (1) 131K 16K N/A N/A Llama 3.1 Euryale 70B v2.2 0.850 0.850 compare (1) 131K 16K N/A N/A Llama 3.2 11B Vision Instruct 0.160 0.160 compare (1) 128K 8K N/A N/A Llama 3.2 11B Vision Instruct 0.015 0.025 compare (7) 131K 16K N/A N/A Llama 3.2 1B 0.100 0.100 compare (3) 131K 8K N/A N/A Llama 3.2 3B 0.100 0.100 compare (3) 131K 8K N/A N/A Llama 3.2 90B Vision Instruct 0.720 0.720 compare (1) 128K 8K N/A N/A Llama 3.2 90B Vision Instruct 0.900 0.900 compare (4) 128K 16K N/A N/A Llama 3.3 70B Instruct 0.720 0.720 compare (4) 131K 8K N/A N/A Llama 3.3 70B Instruct Turbo 0.130 0.390 compare (2) 131K N/A N/A N/A Llama 3.3 70B Versatile 0.590 0.790 compare (1) 128K 33K N/A N/A Llama 3.3 Euryale 2.3 70B 0.650 0.750 compare (1) 131K N/A N/A N/A Llama 3.3 Euryale 70B N/A N/A compare (1) 131K 16K N/A N/A Llama 3.3 Euryale 70B 0.650 0.750 compare (1) 131K 16K N/A N/A Llama 3.3 Nemotron Super 49B V1.5 0.100 0.400 compare (2) 131K N/A N/A N/A Llama 4 17B Maverick N/A N/A compare (1) 128K N/A N/A N/A Llama 4 17B Maverick Instruct N/A N/A compare (1) 128K 4K N/A N/A Llama 4 17B Scout Instruct N/A N/A compare (2) 10.0M 4K N/A N/A Llama 4 Maverick 17B 0.350 1.40 compare (1) 128K N/A N/A N/A Llama 4 Maverick 17B 128E Instruct 0.200 0.600 compare (3) 512K 8K N/A N/A Llama 4 Maverick 17B Instruct 0.050 0.100 compare (7) 1.0M 16K N/A N/A Llama 4 Scout 17B 16E Instruct 0.720 0.720 compare (1) 192K 4K N/A N/A Llama 4 Scout 17B Instruct 0.050 0.100 compare (10) 10.0M 16K N/A N/A Llama Guard 2 8B 0.200 0.200 compare (1) 8K 8K N/A N/A Llama Guard 3 11B Vision 0.350 0.350 compare (1) 128K N/A N/A N/A Llama Guard 3 1B 0.100 0.100 compare (1) 131K N/A N/A N/A Llama Guard 3 8B 0.020 0.030 compare (5) 131K 16K N/A N/A Llama Guard 4 12B 0.180 0.180 compare (3) 164K 8K N/A N/A Llama Guard 7B 0.200 0.200 compare (1) 4K 4K N/A N/A Llama Guard 7B N/A N/A compare (1) 4K 4K N/A N/A Llama4 Maverick Instruct N/A N/A compare (1) 131K N/A N/A N/A Llama4 Maverick Instruct Basic 0.220 0.880 compare (1) 131K N/A N/A N/A Llama4 Scout Instruct N/A N/A compare (1) 131K N/A N/A N/A Llama4 Scout Instruct Basic 0.150 0.600 compare (1) 131K N/A N/A N/A LLaVA 1.6 7B Mistral 0.290 0.290 compare (1) 32K N/A N/A N/A LLaVA Yi 34B 0.900 0.900 compare (1) 4K 4K N/A N/A Llemma 7b N/A N/A compare (1) 4K 4K N/A N/A Maestro Reasoning 0.900 3.30 compare (1) 131K 32K N/A N/A Magistral Medium 1.0 2.00 5.00 compare (1) 40K N/A N/A N/A Magistral Medium 1.1 2.00 5.00 compare (1) 40K N/A N/A N/A Magistral Medium 1.2 N/A N/A compare (1) 40K N/A N/A N/A Magistral Medium 1.2 2.00 5.00 compare (1) 40K N/A N/A N/A Magistral Small 1.0 0.500 1.50 compare (1) 40K N/A N/A N/A Magistral Small 1.1 0.500 1.50 compare (1) 40K N/A N/A N/A Magistral Small 1.2 N/A N/A compare (1) 40K N/A N/A N/A Magistral Small 1.2 0.500 1.50 compare (1) 40K N/A N/A N/A Magnum v4 72B 3.00 5.00 compare (1) 16K 2K N/A N/A MAI DS R1 1.35 5.40 compare (1) 128K 8K N/A N/A Mamba Codestral 7B 0.190 0.190 compare (1) 256K N/A N/A N/A MedLM Large 0.0050 0.015 compare (1) 8K 1K N/A N/A MedLM Medium 0.000500 0.0010 compare (1) 33K 8K N/A N/A Mercury 0.250 0.750 compare (1) 128K 32K N/A N/A Mercury Coder 0.250 0.750 compare (1) 128K 32K N/A N/A Mercury Coder Small Beta 0.250 1.00 compare (1) 32K 16K N/A N/A MiniMax M1 0.400 2.20 compare (1) 1.0M 40K N/A N/A MiniMax M2 MaaS N/A N/A compare (1) 197K N/A N/A N/A MiniMax M2-her 0.300 1.20 compare (1) 66K 2K N/A N/A MiniMax M2.1 Lightning 0.300 2.40 compare (2) 1.0M 131K N/A N/A MiniMax M2.5 High Speed 0.600 2.40 compare (1) 205K 131K N/A N/A MiniMax M2.5 Lightning 0.300 2.40 compare (1) 1.0M 8K N/A N/A MiniMax M2.7 High Speed 0.600 2.40 compare (1) 205K 131K N/A N/A MiniMax-01 0.200 1.10 compare (1) 1.0M N/A N/A N/A Ministral 14B 0.200 0.200 compare (3) 262K N/A N/A N/A Ministral 3 14B Instruct 0.200 0.200 compare (2) 256K 8K N/A N/A Ministral 3 3B Instruct 0.100 0.100 compare (2) 256K 8K N/A N/A Ministral 3 8B Instruct 0.150 0.150 compare (2) 256K 8K N/A N/A Ministral 3B 0.040 0.040 compare (4) 256K 4K N/A N/A Ministral 8B 0.150 0.150 compare (3) 262K 4K N/A N/A Mistral 3 7B Instruct 0.200 0.200 compare (1) 33K N/A N/A N/A Mistral 3 Large 675B Instruct N/A N/A compare (1) 128K 8K N/A N/A Mistral 7B 0.050 0.200 compare (4) 33K 8K N/A N/A Mistral 7B Instruct 4K 0.200 0.200 compare (1) 33K N/A N/A N/A Mistral 7B PairRM DPO N/A N/A compare (1) 33K N/A N/A N/A Mistral Large (24.02) 10.40 31.20 compare (1) 32K 8K N/A N/A Mistral Large (24.07) 3.00 9.00 compare (1) 128K 8K N/A N/A Mistral Large 3 675B Instruct 0.500 1.50 compare (1) 128K 8K N/A N/A Mistral Saba 24B 0.790 0.790 compare (1) 33K N/A N/A N/A Mistral Small (24.02) 1.00 3.00 compare (1) 32K 8K N/A N/A Mistral Small (25.03) 1.00 3.00 compare (1) 32K 8K N/A N/A Mistral Small 24B Instruct 0.050 0.080 compare (3) 33K 16K N/A N/A Mistral Small 3.1 24B 0.100 0.300 compare (2) 128K N/A N/A N/A Mistral Small 3.2 24B Instruct 0.075 0.200 compare (3) 128K N/A N/A N/A Mistral Small Creative 0.100 0.300 compare (1) 33K N/A N/A N/A Mistral Tiny 0.250 0.250 compare (1) 32K 8K N/A N/A Mixtral 8x22B 1.20 1.20 compare (2) 66K 8K N/A N/A Mixtral 8x7B 0.460 0.500 compare (3) 33K 8K N/A N/A Moonshot 1 Auto 2.00 5.00 compare (1) 131K N/A N/A N/A Moonshot V1 128K 2.00 5.00 compare (1) 131K N/A N/A N/A Moonshot V1 128K Vision Preview 2.00 5.00 compare (1) 131K N/A N/A N/A Moonshot V1 32K 1.00 3.00 compare (1) 33K N/A N/A N/A Moonshot V1 32K Vision Preview 1.00 3.00 compare (1) 33K N/A N/A N/A Moonshot V1 8K 0.200 2.00 compare (1) 8K 8K N/A N/A Moonshot V1 8K Vision Preview 0.200 2.00 compare (1) 8K 8K N/A N/A Morph V3 Fast 0.800 1.20 compare (2) 82K 38K N/A N/A Morph V3 Large 0.900 1.90 compare (2) 262K 131K N/A N/A MPT 30B Instruct N/A N/A compare (1) 8K 8K N/A N/A MPT 30B Instruct 1.00 1.00 compare (1) 8K 8K N/A N/A MPT 7B Instruct N/A N/A compare (1) 8K 8K N/A N/A MPT 7B Instruct 0.500 N/A compare (1) 8K 8K N/A N/A mT0 13B XXL N/A N/A compare (1) 8K 8K N/A N/A mT0 XXL 13B 0.500 2.00 compare (1) 8K 8K N/A N/A MythoMax L2 13B 0.060 0.060 compare (4) 4K 4K N/A N/A Nano Banana Pro (Gemini 3 Pro Image) 2.00 12.00 compare (2) 66K 33K N/A N/A Nemo 0.020 0.040 compare (6) 131K 16K N/A N/A Nemo Base 0.200 0.200 compare (1) 128K N/A N/A N/A Nemo Instruct 0.020 0.040 compare (5) 131K N/A N/A N/A Nemotron 2 Nano 12B N/A N/A compare (2) 131K 8K N/A N/A Nemotron 3 Nano 30B N/A N/A compare (2) 262K 8K N/A N/A Nemotron 3 Nano 30B A3B 0.050 0.200 compare (2) 262K N/A N/A N/A Nemotron Nano 2 12B 0.200 0.200 compare (2) 131K 8K N/A N/A Nemotron Nano 3 30B 0.060 0.240 compare (1) 262K 8K N/A N/A Nemotron Super 3 120B 0.150 0.650 compare (1) 256K 33K N/A N/A Nemotron Super 3 120B A12B 0.100 0.500 compare (2) 262K 32K N/A N/A Nova Pro 2 Preview 2.19 17.50 compare (1) 1.0M 64K N/A N/A Nova Sonic 0.060 0.240 compare (1) N/A N/A N/A N/A Nova Sonic 2 0.330 2.75 compare (1) N/A N/A N/A N/A NVIDIA Llama 3.3 Nemotron 1 Super 49B 0.100 0.400 compare (1) 131K N/A N/A N/A o3 1 31 Mini N/A N/A compare (2) 200K 100K N/A N/A o3 6 10 Pro N/A N/A compare (2) 200K 100K N/A N/A o3 Deep Research 2.50 40.00 compare (4) 200K 100K N/A N/A o4 4 16 Mini N/A N/A compare (2) 200K 100K N/A N/A o4 6 26 Mini Deep Research N/A N/A compare (1) 200K 100K N/A N/A o4 Mini Deep Research 2.00 8.00 compare (2) 200K 100K N/A N/A o4 Mini High 1.10 4.40 compare (1) 200K 100K N/A N/A Olmo 2 32B Instruct 0.050 0.200 compare (1) 128K N/A N/A N/A OLMoCR 7B 0.270 1.50 compare (1) 16K 16K N/A N/A OpenChat 3.5 106 7B 0.200 0.200 compare (1) 8K 8K N/A N/A OpenChat 3.5 7B N/A N/A compare (1) 8K 8K N/A N/A OpenOrca 7B 0.200 0.200 compare (1) 33K N/A N/A N/A Palmyra Vision 7B 0.150 0.600 compare (1) N/A N/A N/A N/A Palmyra X4 2.50 10.00 compare (1) 128K 8K N/A N/A Palmyra X5 0.600 6.00 compare (2) 1.0M 8K N/A N/A Pegasus V1.2 N/A 7.50 compare (1) N/A N/A N/A N/A Phi-2 3B 0.100 0.100 compare (1) 2K 2K N/A N/A Phi-3 Medium Instruct 0.170 0.680 compare (1) 128K 4K N/A N/A Phi-3 Mini Instruct 0.100 0.100 compare (2) 131K 4K N/A N/A Phi-3 Small Instruct 0.150 0.600 compare (1) 128K 4K N/A N/A Phi-3 Vision 128K Instruct 0.200 0.200 compare (1) 32K N/A N/A N/A Phi-3 Vision Instruct N/A N/A compare (1) 32K N/A N/A N/A Phi-3.5 Mini Instruct 0.130 0.520 compare (1) 128K 4K N/A N/A Phi-3.5 MoE Instruct 0.160 0.640 compare (1) 128K 4K N/A N/A Phi-3.5 Vision Instruct 0.130 0.520 compare (1) 128K 4K N/A N/A Phi-4 Mini Instruct 0.075 0.300 compare (1) 131K 4K N/A N/A Phi-4 Mini Reasoning 0.080 0.320 compare (1) 131K 4K N/A N/A Phi-4 Multimodal Instruct 0.080 0.320 compare (1) 131K 4K N/A N/A Phi-4 Reasoning 0.125 0.500 compare (1) 33K 4K N/A N/A Phind Code Llama 1 34B 0.900 0.900 compare (1) 16K 16K N/A N/A Phind Code Llama 1 34B Python 0.900 0.900 compare (1) 16K 16K N/A N/A Phind Code Llama 2 34B 0.900 0.900 compare (1) 16K 16K N/A N/A Pixtral N/A N/A compare (1) 128K N/A N/A N/A Pixtral 12B 0.150 0.150 compare (3) 128K 4K N/A N/A Pixtral Large (25.02) 2.00 6.00 compare (1) 128K 4K N/A N/A PPLX 70B Chat 0.700 2.80 compare (1) 4K 4K N/A N/A PPLX 70B Online N/A 2.80 compare (1) 4K 4K N/A N/A PPLX 7B Chat 0.070 0.280 compare (1) 8K 8K N/A N/A PPLX 7B Online N/A 0.280 compare (1) 4K 4K N/A N/A Pythia 12B 0.200 0.200 compare (1) 2K 2K N/A N/A QVQ 72B Preview 1.72 5.16 compare (1) 33K 16K N/A N/A QVQ Max 1.20 4.80 compare (1) 131K 8K N/A N/A QVQ Plus 0.287 0.717 compare (1) 131K 8K N/A N/A Qwen 1 25 Plus N/A N/A compare (1) 129K 8K N/A N/A Qwen 3 32B N/A N/A compare (2) 128K 16K N/A N/A Qwen 3 Coder 30B A3B Instruct 0.150 0.600 compare (2) 262K 131K N/A N/A Qwen 4 28 Plus N/A N/A compare (1) 129K 16K N/A N/A Qwen Coder 0.300 1.50 compare (1) 1.0M 16K N/A N/A Qwen Coder Plus 0.502 1.00 compare (1) 131K 8K N/A N/A Qwen Coder Turbo 0.287 0.861 compare (1) 131K 8K N/A N/A Qwen Deep Research 7.74 23.37 compare (1) 1.0M 33K N/A N/A Qwen Doc Turbo 0.087 0.144 compare (1) 262K 33K N/A N/A Qwen Flash 0.050 0.400 compare (1) 1.0M 33K N/A N/A Qwen Flash 0.050 0.400 compare (1) 1.0M 33K N/A N/A Qwen Long 0.072 0.287 compare (1) 10.0M 33K N/A N/A Qwen Math Plus 0.574 1.72 compare (1) 4K 3K N/A N/A Qwen Math Turbo 0.287 0.861 compare (1) 4K 3K N/A N/A Qwen MT Flash 0.160 0.490 compare (1) 16K 8K N/A N/A Qwen MT Lite 0.120 0.360 compare (1) 16K 8K N/A N/A Qwen MT Plus 0.250 0.750 compare (2) 16K 8K N/A N/A Qwen MT Turbo 0.160 0.490 compare (1) 16K 8K N/A N/A Qwen Plus 0.260 0.780 compare (2) 1.0M 33K N/A N/A Qwen Plus 0.400 1.20 compare (1) 1.0M 33K N/A N/A Qwen Plus 0728 0.260 0.780 compare (1) 1.0M 33K N/A N/A Qwen Plus Character 0.500 1.40 compare (1) 33K 4K N/A N/A Qwen Plus Character JA 0.500 1.40 compare (1) 8K 512 N/A N/A Qwen VL Max 0.520 2.08 compare (2) 131K 33K N/A N/A Qwen VL Plus 0.137 0.409 compare (2) 131K 8K N/A N/A Qwen-Max 1.04 4.16 compare (2) 33K 8K N/A N/A Qwen1.5 72B Chat 0.900 0.900 compare (1) 33K N/A N/A N/A Qwen1.5 7B Code 0.200 0.200 compare (1) 66K N/A N/A N/A Qwen2 72B 0.900 0.900 compare (1) 131K N/A N/A N/A Qwen2 7B Instruct 0.200 0.200 compare (1) 33K N/A N/A N/A Qwen2 VL 2B Instruct 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2 VL 72B Instruct 0.130 0.400 compare (3) 131K 2K N/A N/A Qwen2 VL 7B Instruct 0.020 0.060 compare (2) 131K N/A N/A N/A Qwen2.5 0.5B Instruct 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 1.5B Instruct 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 14B 0.200 0.200 compare (1) 131K N/A N/A N/A Qwen2.5 14B Instruct 0.200 0.200 compare (2) 131K 8K N/A N/A Qwen2.5 14B Instruct 1M 0.805 3.22 compare (1) 1.0M 8K N/A N/A Qwen2.5 32B 0.900 0.900 compare (1) 131K N/A N/A N/A Qwen2.5 3B Instruct 0.044 0.130 compare (1) 33K 8K N/A N/A Qwen2.5 72B 0.900 0.900 compare (1) 131K N/A N/A N/A Qwen2.5 7B 0.200 0.200 compare (1) 131K N/A N/A N/A Qwen2.5 7B Instruct 0.040 0.070 compare (6) 131K 8K N/A N/A Qwen2.5 7B Instruct 1M 0.368 1.47 compare (1) 1.0M 8K N/A N/A Qwen2.5 Coder 0.5B 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 0.5B Instruct 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 1.5B 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 1.5B Instruct 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 14B 0.200 0.200 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 14B Instruct 0.200 0.200 compare (2) 131K 8K N/A N/A Qwen2.5 Coder 32B 0.900 0.900 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 32B Instruct 128K N/A N/A compare (1) 131K N/A N/A N/A Qwen2.5 Coder 32B Instruct 32K RoPE N/A N/A compare (1) 33K N/A N/A N/A Qwen2.5 Coder 32B Instruct 64K N/A N/A compare (1) 66K N/A N/A N/A Qwen2.5 Coder 3B 0.100 0.100 compare (1) 33K N/A N/A N/A Qwen2.5 Coder 3B Instruct 0.010 0.030 compare (2) 33K N/A N/A N/A Qwen2.5 Coder 7B 0.010 0.030 compare (2) 33K 8K N/A N/A Qwen2.5 Math 72B Instruct 0.574 0.900 compare (2) 4K 4K N/A N/A Qwen2.5 Math 7B Instruct 0.144 0.287 compare (1) 4K 3K N/A N/A Qwen2.5 VL 32B Instruct 0.200 0.600 compare (4) 131K 8K N/A N/A Qwen2.5 VL 3B Instruct 0.200 0.200 compare (2) 131K 8K N/A N/A Qwen2.5 VL 72B Instruct 0.130 0.400 compare (6) 131K 8K N/A N/A Qwen2.5 VL 7B Instruct 0.200 0.200 compare (2) 131K 8K N/A N/A Qwen3 1.7B FP8 Draft 0.100 0.100 compare (1) 262K N/A N/A N/A Qwen3 235B A22B FP8 0.200 0.800 compare (1) 41K 20K N/A N/A Qwen3 235B A22b Instruct 2507 0.600 1.20 compare (1) 131K 40K N/A N/A Qwen3 235B A22B Thinking 0.149 0.880 compare (7) 262K 33K N/A N/A Qwen3 30B A3B FP8 0.090 0.450 compare (1) 41K 20K N/A N/A Qwen3 30B A3B Thinking 0.080 0.400 compare (3) 262K 33K N/A N/A Qwen3 32B FP8 0.050 0.100 compare (2) 131K 20K N/A N/A Qwen3 4B FP8 0.030 0.030 compare (1) 128K 20K N/A N/A Qwen3 8B FP8 0.035 0.138 compare (1) 128K 20K N/A N/A Qwen3 9.23 Max N/A N/A compare (1) N/A N/A N/A N/A Qwen3 Coder 0.220 1.00 compare (2) 262K 67K N/A N/A Qwen3 Coder 480B A35B 0.450 1.80 compare (1) 262K 66K N/A N/A Qwen3 Coder 480B A35B Instruct Turbo 0.290 1.20 compare (1) 262K N/A N/A N/A Qwen3 Coder 480B Instruct 0.900 0.900 compare (1) 4K 4K N/A N/A Qwen3 Coder Flash 0.195 0.975 compare (2) 1.0M 66K N/A N/A Qwen3 Coder Plus 0.650 3.25 compare (3) 1.0M 66K N/A N/A Qwen3 Next 80B A3B Instruct MaaS 0.150 1.20 compare (1) 262K N/A N/A N/A Qwen3 Next 80B A3B Thinking 0.098 0.780 compare (7) 262K 66K N/A N/A Qwen3 Next 80B A3B Thinking MaaS 0.150 1.20 compare (1) 262K N/A N/A N/A Qwen3 Omni 30B A3B Captioner 3.81 3.06 compare (1) 66K 33K N/A N/A Qwen3 Omni 30B A3B Thinking 0.250 0.970 compare (1) 66K 16K N/A N/A Qwen3 VL 235B A22B Instruct 0.200 0.880 compare (1) 262K N/A N/A N/A Qwen3 VL 235B A22B Instruct FP8 0.300 1.40 compare (1) 262K 16K N/A N/A Qwen3 VL 235B A22B Thinking 0.220 0.880 compare (4) 262K 33K N/A N/A Qwen3 VL 235B A22B Thinking 0.400 4.00 compare (1) 131K 33K N/A N/A Qwen3 VL 30B A3B Thinking 0.130 0.600 compare (4) 262K 33K N/A N/A Qwen3 VL 32B Thinking 0.160 0.640 compare (1) 131K 33K N/A N/A Qwen3 VL 8B Thinking 0.117 1.36 compare (2) 131K 33K N/A N/A Qwen3 VL Flash 0.200 1.60 compare (1) 262K 33K N/A N/A Qwen3 VL Flash 0.050 0.400 compare (1) 262K 33K N/A N/A Qwen3 VL Plus 0.200 1.60 compare (1) 262K 33K N/A N/A Qwen3-30B-A3B 0.080 0.290 compare (1) 41K 16K N/A N/A Qwen3.5 Max N/A N/A compare (1) 258K 66K N/A N/A Qwen3.5 Plus 2026-02-15 0.260 1.56 compare (1) 1.0M 66K N/A N/A Qwen3.5-Flash 0.065 0.260 compare (1) 1.0M 66K N/A N/A QwQ Plus 0.800 2.40 compare (1) 131K 8K N/A N/A Reka Core 11.00 11.00 compare (1) 32K 8K N/A N/A Reka Edge 0.100 0.100 compare (1) 16K 16K N/A N/A Relace Apply 3 0.850 1.25 compare (1) 256K 128K N/A N/A Relace Search 1.00 3.00 compare (1) 256K 128K N/A N/A ReMM SLERP 13B 0.450 0.650 compare (1) 6K 4K N/A N/A Rnj 1 Instruct 0.150 0.150 compare (1) 33K N/A N/A N/A Rocinante 12B 0.170 0.430 compare (1) 33K N/A N/A N/A Seed 1.6 0.250 2.00 compare (2) 262K 33K N/A N/A Seed 1.6 Flash 0.075 0.300 compare (1) 262K 33K N/A N/A Seed-2.0-Lite 0.250 2.00 compare (1) 262K 131K N/A N/A Seed-2.0-Mini 0.100 0.400 compare (1) 262K 131K N/A N/A Skyfall 36B V2 0.550 0.800 compare (1) 33K N/A N/A N/A Skywork R1 4 Lite N/A N/A compare (1) 262K 66K N/A N/A Skywork R1V4 Lite 0.200 0.600 compare (1) 262K 66K N/A N/A Snorkel Mistral PairRM DPO 0.200 0.200 compare (1) 33K N/A N/A N/A Sonar Deep Research 2.00 8.00 compare (2) 128K N/A N/A N/A Sonar Medium Chat 0.600 1.80 compare (1) 16K 16K N/A N/A Sonar Medium Online N/A 1.80 compare (1) 12K 12K N/A N/A Sonar Pro Search 3.00 15.00 compare (1) 200K 8K N/A N/A Sonar Small Chat 0.070 0.280 compare (1) 16K 16K N/A N/A Sonar Small Online N/A 0.280 compare (1) 12K 12K N/A N/A Spotlight 0.180 0.180 compare (1) 131K 66K N/A N/A StableCode 3B 0.100 0.100 compare (1) 4K 4K N/A N/A StarCoder 16B N/A N/A compare (1) 8K 8K N/A N/A StarCoder 16B 0.200 0.200 compare (1) 8K 8K N/A N/A StarCoder 7B N/A N/A compare (1) 8K 8K N/A N/A StarCoder 7B 0.200 0.200 compare (1) 8K 8K N/A N/A StarCoder2 15B N/A N/A compare (1) 16K 16K N/A N/A StarCoder2 15B 0.200 0.200 compare (1) 16K 16K N/A N/A StarCoder2 3B N/A N/A compare (1) 16K 16K N/A N/A StarCoder2 3B 0.100 0.100 compare (1) 16K 16K N/A N/A StarCoder2 7B N/A N/A compare (1) 16K 16K N/A N/A StarCoder2 7B 0.200 0.200 compare (1) 16K 16K N/A N/A Switchpoint Router 0.850 3.40 compare (1) 131K N/A N/A N/A Text Unicorn 10.00 28.00 compare (1) 8K 1K N/A N/A Titan Express Text V1 1.30 1.70 compare (1) 42K 8K N/A N/A Titan Lite Text V1 0.300 0.400 compare (1) 42K 4K N/A N/A Titan Premier Text V1 0.500 1.50 compare (1) 42K 32K N/A N/A Together AI 110B N/A N/A compare (1) N/A N/A N/A N/A Together AI 21 1B–41B 0.800 0.800 compare (1) N/A N/A N/A N/A Together AI 21B N/A N/A compare (1) N/A N/A N/A N/A Together AI 4 1B–8B 0.200 0.200 compare (1) N/A N/A N/A N/A Together AI 41 1B–80B 0.900 0.900 compare (1) N/A N/A N/A N/A Together AI 41B N/A N/A compare (1) N/A N/A N/A N/A Together AI 4B N/A N/A compare (1) N/A N/A N/A N/A Together AI 8 1B–21B 0.300 0.300 compare (1) N/A N/A N/A N/A Together AI 80B N/A N/A compare (1) N/A N/A N/A N/A Together AI 81 1B–110B 1.80 1.80 compare (1) N/A N/A N/A N/A Together AI 8B N/A N/A compare (1) N/A N/A N/A N/A Together AI Up to 4B 0.100 0.100 compare (1) N/A N/A N/A N/A Tongyi DeepResearch 30B A3B 0.090 0.450 compare (1) 131K N/A N/A N/A Tongyi Intent Detect 3 0.058 0.144 compare (1) 8K 1K N/A N/A Trinity Large Preview 0.250 1.00 compare (1) 131K N/A N/A N/A Trinity Mini 0.045 0.150 compare (2) 131K N/A N/A N/A UI-TARS 7B 0.100 0.200 compare (1) 131K 2K N/A N/A UnslopNemo 12B 0.400 0.400 compare (1) 33K N/A N/A N/A Vercel V0 1 MD 3.00 15.00 compare (1) 128K 32K N/A N/A Vercel V0 1.5 LG 15.00 75.00 compare (1) 512K N/A N/A N/A Vercel V0 1.5 MD 3.00 15.00 compare (1) 128K 33K N/A N/A Virtuoso Large 0.750 1.20 compare (1) 131K 64K N/A N/A Weaver 0.750 1.00 compare (1) 8K 2K N/A N/A WizardLM 2 8x22B 0.480 0.480 compare (3) 66K 8K N/A N/A Yi 34B 0.900 0.900 compare (1) 4K 4K N/A N/A Yi 34B 200K Capybara N/A N/A compare (1) 200K N/A N/A N/A Yi 34B Capybara 0.900 0.900 compare (1) 200K N/A N/A N/A Yi 34B Chat 0.900 0.900 compare (1) 4K 4K N/A N/A Yi 6B 0.200 0.200 compare (1) 4K 4K N/A N/A Yi Large 3.00 3.00 compare (1) 33K N/A N/A N/A Zephyr 7B Beta 0.200 0.200 compare (1) 33K 16K N/A N/A 
Google
OpenAI
Alibaba
MiniMax
Xiaomi
xAI
Zhipu AI
Anthropic
KwaiPilot
Moonshot AI (Kimi)
StepFun
Inception
Arcee AI
DeepSeek
Mistral AI
Upstage
Perplexity
Prime Intellect
Amazon
Meta
NVIDIA
Baidu
Allen AI
Cohere
Reka AI
AI21 Labs
Nous Research
Liquid AI
Microsoft
IBM
Aion Labs
Snowflake
Baichuan
ByteDance
DeepCogito
DataForSEO
Databricks
TNG Technology
Sentient
DuckDuckGo
Fireworks AI
Black Forest Labs
Tencent
Inflection AI
InternLM
Core42
01.AI
EleutherAI
Snorkel AI
Morph
Writer
Twelve Labs
Relace
Essential AI
Skywork
Stability AI
BigCode
Hugging Face
Together AI
Vercel