AI Benchmark

Compare Leading AI & LLM Models

Compare performance metrics, benchmarks, and pricing across the leading AI models. Sort by any metric and find the best model for your use case.

Model Leaderboard

Showing 296 of 296 models
Org
🌍
Model
Multimodal
GPQA
AIME 2025
SWE-bench
HLE
Input $/M
Output $/M
Context
Cutoff
Params (B)
License
Speed
Latency
Released
Code Arena
Reasoning
Math
Coding
Search
Writing
Vision
Tools
Long Ctx
Finance
Legal
Health
ARC-AGI v2
MMMLU
MMMU
BrowseComp
CharXiv-R
MMMU-Pro
ScreenSpot Pro
MCP Atlas
SimpleQA
OSWorld
Toolathlon
Terminal Bench
TAU2 Retail
FrontierMath
MRCR v2
SciCode
Apex Agents
SWE-bench Pro
Anthropic🇺🇸Claude Mythos Preview UNRELEASED✓94.6%-93.9%64.7%$25.00$125.00--- Closed ----71.461.757.341.3-52.639.636.8--24.3-92.7%-86.9%93.2%------------77.8%
Google🇺🇸Gemini 3.1 Pro✓94.3%-80.6%51.4%$2.50$15.001.0MJan. 2025- Closed 114c/s29.1sFeb. 20262,09359.054.744.137.0-41.034.113.24.84.819.977.1%92.6%-85.9%-80.5%-69.2%------26.3%59.0%33.5%54.2%
Anthropic🇺🇸Claude Opus 4.7✓94.2%-87.6%54.7%$5.00$25.001M-- Closed 108c/s2.2sApr. 20261,79162.852.151.631.4-44.639.629.540.6-38.1-91.5%-79.3%91.0%--77.3%---------64.3%
OpenAI🇺🇸GPT-5.5 NEW✓93.6%--52.2%$5.00$30.001M-- Closed --Apr. 2026-63.148.553.135.630.846.940.430.521.8--85.0%--84.4%-83.2%-75.3%--55.6%--35.4%74.0%--58.6%
OpenAI🇺🇸GPT-5.2 Pro✓93.2%100.0%-36.6%$21.00$168.00400k-- Closed --Dec. 2025-56.651.3-29.5-33.2-----54.2%--77.9%--------------
OpenAI🇺🇸GPT-5.4✓92.8%--39.8%$2.50$15.001M-- Closed 244c/s1.1sMar. 20261,74158.047.344.332.035.538.436.327.52.0-39.973.3%--82.7%-81.2%-67.2%--54.6%--47.6%---57.7%
OpenAI🇺🇸GPT-5.2✓92.4%100.0%80.0%34.5%$1.75$14.00400kAug. 2025- Closed 176c/s29.3sDec. 20251,52254.350.935.726.133.135.828.7---44.452.9%89.6%-65.8%82.1%79.5%86.3%60.6%--46.3%--40.3%----
Google🇺🇸Gemini 3 Pro✓91.9%100.0%76.2%45.8%---Jan. 2025- Closed --Nov. 20251,57949.950.033.4--35.119.89.9--50.031.1%91.8%--81.4%81.0%72.7%-72.1%-----26.3%---
Anthropic🇺🇸Claude Opus 4.6✓91.3%99.8%80.8%53.1%$5.00$25.001M-- Closed 116c/s1.9sFeb. 20262,00560.052.345.638.744.636.635.136.637.139.314.068.8%91.1%-84.0%77.4%77.3%-62.7%-72.7%----93.0%---
MoonshotAI🇨🇳Kimi K2.6 NEW✓90.5%-80.2%36.4%$0.95$4.00262.1k-1000 Open 82c/s64.4sApr. 20261,17959.550.745.638.0-38.833.4-------86.3%86.7%80.1%----50.0%----52.2%27.9%58.6%
Google🇺🇸Gemini 3 Flash✓90.4%99.7%78.0%43.5%$0.50$3.001MJan. 2025- Closed 215c/s5.2sDec. 20251,69049.550.631.5--34.124.15.3--43.633.6%91.8%--80.3%81.2%69.1%57.4%68.7%-49.4%---22.1%---
Qwen🇨🇳Qwen3.6 Plus✓90.4%-78.8%28.8%----- Closed --Mar. 2026-52.349.943.325.2-35.831.037.456.956.954.1-89.5%86.0%-81.5%78.8%68.2%74.1%--39.8%------56.6%
DeepSeek🇨🇳DeepSeek-V4-Pro-Max NEWx90.1%-80.6%48.2%$1.74$3.481.0M-1600 Open 52c/s53.2sApr. 20264157.853.845.033.5-33.635.220.045.245.748.8---83.4%---73.6%57.9%-51.8%------55.4%
Anthropic🇺🇸Claude Sonnet 4.6✓89.9%-79.6%49.0%$3.00$15.00200k-- Closed 143c/s1.5sFeb. 20261,42152.643.937.724.835.634.029.826.341.642.711.658.3%89.3%-74.7%-75.6%-61.3%-72.5%--------
Meta🇺🇸Muse Spark✓89.5%-77.4%58.4%----- Closed --Apr. 2026-52.955.232.91.920.339.722.4-28.929.144.942.5%---86.4%80.4%84.1%----------52.4%
Bytedance🇨🇳Seed 2.0 Pro✓88.9%98.3%76.5%----Jan. 2024- Closed --Feb. 2026-54.645.333.328.9----------77.3%--------------
Qwen🇨🇳Qwen3.5-397B-A17B✓88.4%-76.4%28.7%$0.60$3.60262.1k-397 Open 84c/s18.9sFeb. 20261,20849.646.831.025.828.729.022.838.955.455.454.4-88.5%-69.0%------38.3%-------
xAI🇺🇸Grok-4 Heavy UNRELEASED✓88.4%100.0%-50.7%---Dec. 2024- Closed ----53.353.525.6--36.5-----------------------
OpenAI🇺🇸GPT-5.1✓88.1%94.0%76.3%-$1.25$10.00400kSep. 2024- Closed 277c/s3.2sNov. 20251,23148.140.031.822.228.333.425.3---48.1--85.4%----------26.7%----
OpenAI🇺🇸GPT-5.1 High✓88.1%99.6%------- Closed --Nov. 20251,14053.547.7---------------------------
OpenAI🇺🇸GPT-5 Medium✓88.1%88.9%--$1.25$10.00400kSep. 2024- Closed 100c/s39.4sAug. 20251,08944.529.5---------------------------
OpenAI🇺🇸GPT-5.1 Thinking✓88.1%94.0%76.3%-$1.25$10.00400k-- Closed 165c/s32.3sNov. 20251,00346.338.630.813.725.431.922.4---44.4--85.4%----------26.7%----
OpenAI🇺🇸GPT-5.1 Instant✓88.1%94.0%76.3%-$1.25$10.00400k-- Closed 261c/s2.9sNov. 202577049.741.431.318.326.935.123.8---46.0--85.4%----------26.7%----
DeepSeek🇨🇳DeepSeek-V4-Flash-Max NEWx88.1%-79.0%45.1%$0.14$0.281.0M-284 Open --Apr. 2026-52.351.538.823.9-31.128.37.936.536.544.8---73.2%---69.0%34.1%-47.8%------52.6%
OpenAI🇺🇸GPT-5.4 mini✓88.0%--28.2%$0.75$4.50400kAug. 2025- Closed 291c/s745msMar. 202652046.236.435.4-22.229.525.019.4--36.1-----76.6%-57.7%--42.9%---33.6%--54.4%
Qwen🇨🇳Qwen3.6-27B NEW✓87.8%-77.2%24.0%$0.60$3.60262.1k-27.8 Open --Apr. 2026-46.243.335.5--30.724.829.246.946.946.5--82.9%-78.4%75.8%-----------53.5%
MoonshotAI🇨🇳Kimi K2.5✓87.6%96.1%76.8%50.2%$0.60$3.00262.1k-1000 Open 41c/s77.9sJan. 20261,47950.547.932.530.4-35.914.639.247.747.749.7---74.9%77.5%78.5%---------48.7%-50.7%
xAI🇺🇸Grok-4✓87.5%91.7%-40.0%---Dec. 2024- Closed --Jul. 202548744.540.623.6--28.1-----15.9%-----------------
OpenAI🇺🇸GPT-5 High✓87.3%94.6%-----Sep. 2024- Closed --Aug. 20251,30148.040.2---------------------------
Anthropic🇺🇸Claude Opus 4.5✓87.0%-80.9%-$5.00$25.00200kMar. 2025- Closed 257c/s1.6sNov. 20251,61454.542.241.0-35.630.030.8---24.237.6%90.8%-----62.3%-66.3%--------
Google🇺🇸Gemini 3.1 Flash-Lite✓86.9%--16.0%$0.25$1.501MJan. 2025- Closed 237c/s6.2sMar. 20261,16442.031.9---25.9-30.4--38.9-88.9%--73.2%76.8%--43.3%-----60.1%---
Qwen🇨🇳Qwen3.5-122B-A10B✓86.6%-72.0%47.5%$0.40$3.20262.1k-122 Open 136c/s20.4sFeb. 202680243.644.426.622.224.331.414.132.549.949.948.1-86.7%83.9%63.8%77.2%76.9%70.4%-----------
Google🇺🇸Gemini 2.5 Pro Preview 06-05✓86.4%88.0%67.2%21.6%$1.25$10.001.0MJan. 2025- Closed --Jun. 2025-38.232.321.9--26.6--3.4--40.2--82.0%-----54.0%-----16.4%---
ZAI🇨🇳GLM-5.1x86.2%--52.3%$1.40$4.40200k-754 Open 96c/s52.4sApr. 20261,42354.946.445.130.1-39.530.6-------79.3%---71.8%--40.7%------58.4%
Qwen🇨🇳Qwen3.6-35B-A3B✓86.0%-73.4%21.4%----35 Open --Apr. 2026-42.739.929.813.4-28.917.728.741.942.042.8--81.7%-78.0%75.3%-62.8%--26.9%------49.5%
ZAI🇨🇳GLM-4.7✓85.7%95.7%73.8%42.8%$0.60$2.20204.8k-358 Open 230c/s9.3sDec. 20251,04644.244.023.216.8-29.812.5-36.636.536.3---52.0%-------33.3%------
OpenAI🇺🇸GPT-5✓85.7%94.6%74.9%24.8%---Sep. 2024- Closed --Aug. 202588646.239.034.513.229.533.223.832.645.545.642.2--84.2%54.9%81.1%78.4%-------26.3%----
xAI🇺🇸Grok 4 Fast✓85.7%92.0%-20.0%$0.20$0.502M-- Closed --Aug. 2025-41.436.826.76.9-17.4--------44.9%----95.0%---------
Qwen🇨🇳Qwen3.5-27B✓85.5%-72.4%48.5%$0.30$2.40262.1k-27 Open 3c/s14.6sFeb. 202652142.642.822.120.522.230.113.331.146.446.544.2-85.9%82.3%61.0%79.5%75.0%70.3%-----------
Bytedance🇨🇳Seed 2.0 Lite✓85.1%93.0%73.5%----Jan. 2024- Closed --Feb. 2026-42.632.826.3--------------------------
Baidu🇨🇳ERNIE 5.0✓85.0%87.0%-39.0%----- Closed --Jan. 2026-44.140.5---27.9--46.846.846.6--------75.0%---------
Anthropic🇺🇸Claude 3.7 Sonnet✓84.8%54.8%70.3%-$3.00$15.00200k-- Closed --Feb. 202563229.721.219.9-23.718.221.9---27.8-86.1%75.0%--------35.2%81.2%-----
xAI🇺🇸Grok-3✓84.6%93.3%--$3.00$15.00128kNov. 2024- Closed --Feb. 2025-40.739.026.5--21.2----31.6--78.0%---------------
MoonshotAI🇨🇳Kimi K2-Thinking-0905x84.5%100.0%71.3%51.0%----1000 Open --Sep. 202594145.947.526.619.9-6.336.8--26.426.339.2---60.2%-------47.1%---44.8%--
Google🇺🇸Gemma 4 31B✓84.3%--26.5%$0.14$0.40262.1kJan. 202530.7 Open 80c/s2.5sApr. 202664045.439.9---28.120.129.742.442.439.6-88.4%---76.9%------------
Qwen🇨🇳Qwen3.5-35B-A3B✓84.2%-69.2%47.4%$0.25$2.00262.1k-35 Open 175c/s11.5sFeb. 202657339.238.816.817.818.827.113.326.941.942.140.4-85.2%81.4%61.0%77.5%75.1%68.6%-----------
OpenAI🇺🇸ChatGPT-4o Latest✓84.0%---$2.50$10.00128k-- Closed --May 202434641.0----------------------------
xAI🇺🇸Grok-3 Mini✓84.0%90.8%--$0.30$0.50128kNov. 2024- Closed 105c/s7.9sFeb. 202532342.338.027.9--------------------------
Xiaomi🇨🇳MiMo-V2-Flashx83.7%94.1%73.4%22.1%$0.10$0.30256k-309 Open --Dec. 202579338.938.123.615.9-19.39.822.238.638.638.4---58.3%-------30.5%------
Anthropic🇺🇸Claude Sonnet 4.5✓83.4%87.0%--$3.00$15.00200kJan. 2025- Closed 159c/s1.4sSep. 20251,10140.432.932.0-35.319.433.819.0--16.7-89.1%-------61.4%-50.0%86.2%-----
OpenAI🇺🇸o3✓83.3%86.4%69.1%14.7%$2.00$8.00200kMay 2024- Closed --Apr. 2025-38.932.520.59.723.028.616.3---41.26.5%-82.9%49.7%78.6%76.4%-------15.8%----
Google🇺🇸Gemini 2.5 Pro✓83.0%83.0%63.2%17.8%$1.25$10.001.0MJan. 2025- Closed 112c/s7.2sMay 202593335.531.617.4--23.3-29.8--32.74.9%-79.6%-----50.8%---------
Google🇺🇸Gemini 2.5 Flash✓82.8%72.0%60.4%11.0%$0.30$2.501.0MJan. 2025- Closed 285c/s4.2sMay 202578328.923.412.4--17.3-19.1--33.3--79.7%-----26.9%---------
OpenAI🇺🇸GPT-5.4 nano✓82.8%--24.3%$0.20$1.25400kAug. 2025- Closed 335c/s821msMar. 202666840.233.424.1-20.922.116.419.4--42.5-----66.1%-56.1%--35.5%---33.1%--52.4%
Nvidia🇺🇸Nemotron 3 Super (120B A12B)x82.7%90.2%53.7%22.8%---Jun. 2025120 Open --Mar. 2026-6330.638.117.4-0.113.619.75.819.036.036.135.8---31.3%-------25.8%---42.0%--
DeepSeek🇨🇳DeepSeek-V3.2 (Thinking)x82.4%93.1%73.1%25.1%----685 Open --Dec. 202539342.839.329.915.0-22.114.8-40.440.440.1---51.4%------35.2%-------
DeepSeek🇨🇳DeepSeek-V3.2x82.4%93.1%73.1%40.8%$0.26$0.38163.8k-685 Open 32c/s6.1sDec. 202537842.339.128.813.7-29.215.7-39.739.739.5---51.4%------35.2%-------
OpenAI🇺🇸GPT-5 mini✓82.3%91.1%-16.7%$0.25$2.00400kMay 2024- Closed 147c/s16.0sAug. 20251,09537.133.3---12.9------------------22.1%----
Google🇺🇸Gemma 4 26B-A4B✓82.3%--17.2%$0.13$0.40262.1kJan. 202525.2 Open 142c/s1.2sApr. 202693536.031.9---21.118.415.932.632.631.4-86.3%---73.8%------------
Qwen🇨🇳Qwen3.5-9B✓81.7%-------9 Open --Mar. 2026-29.729.0--16.219.99.222.330.930.930.6-81.2%----------------
Meituan🇨🇳LongCat-Flash-Thinkingx81.5%90.6%59.4%-----560 Open --Sep. 202579136.134.219.4-23.716.621.6-36.632.532.2------------------
OpenAI🇺🇸o4-mini✓81.4%92.7%68.1%14.7%$1.10$4.40200kMay 2024- Closed --Apr. 2025-34.735.216.012.514.822.814.5---35.3--81.6%51.5%72.0%-------71.8%-----
Qwen🇨🇳Qwen3-235B-A22B-Thinking-2507x81.1%92.3%-18.2%$0.30$3.00262.1k-235 Open 169c/s1.6sJul. 202534434.738.3--18.120.813.0-42.143.141.5------------67.8%-----
ZAI🇨🇳GLM-4.6✓81.0%93.9%68.0%17.2%$0.55$2.19131.1k-357 Open 51c/s6.1sSep. 20251,13538.434.720.57.4-14.1--------45.1%-------40.5%------
MiniMax🇨🇳MiniMax M2.1x81.0%81.0%67.0%22.0%$0.30$1.201M-230 Open 328c/s2.6sDec. 202592641.636.827.619.118.218.621.120.151.551.551.1---62.0%------43.5%47.9%---39.0%--
DeepSeek🇨🇳DeepSeek-R1-0528x81.0%87.5%44.6%17.7%$0.55$2.19131.1k-671 Open 83c/s2.9sMay 202535731.533.412.6-14.0-14.6--40.640.640.4---8.9%----92.3%--5.7%------
Anthropic🇺🇸Claude Opus 4.1✓80.9%78.0%74.5%-$15.00$75.00200k-- Closed 123c/s1.4sAug. 20251,16738.330.328.6-24.721.823.0---16.9-89.5%---------43.3%82.4%-----
OpenAI🇺🇸GPT OSS 120B Highx80.9%92.5%--$0.10$0.50131.1k-116.8 Open 125c/s19.2sAug. 202551732.429.1----2.2-26.826.826.5-83.8%----------------
Meituan🇨🇳LongCat-Flash-Thinking-2601x80.5%99.6%70.0%25.2%$0.30$1.20128k-560 Open 42c/s89.4sJan. 202653146.441.926.118.738.023.034.2-------56.6%--------------
OpenAI🇺🇸GPT OSS 120Bx80.1%--14.9%$0.09$0.45131.1k-116.8 Open 113c/s3.7sAug. 202533031.532.2--10.310.68.4-32.032.134.7------------67.8%-----
DeepSeek🇨🇳DeepSeek-V3.2-Expx79.9%89.3%67.8%19.8%----685 Open --Sep. 202575036.133.822.31.9-16.5--39.139.138.9---40.1%----97.1%--37.7%------
Anthropic🇺🇸Claude Opus 4✓79.6%75.5%72.5%------ Closed --May 202593235.627.422.8-25.021.323.2---8.88.6%88.8%---------39.2%81.4%-----
ZAI🇨🇳GLM-4.5x79.1%-64.2%14.4%----355 Open --Jul. 202574434.534.621.3-4.225.28.825.8-42.037.937.7---26.4%-------37.5%79.7%--41.7%--
OpenAI🇺🇸o1-pro✓79.0%------Sep. 2023- Closed --Dec. 2024-28.824.3---------------------------
Sarvam AI🇮🇳Sarvam-105Bx78.7%96.7%45.0%11.2%----105 Open --Mar. 2026-33.035.53.99.0-6.5--35.435.434.8---49.5%--------------
MiniMax🇨🇳MiniMax M2x78.0%78.0%69.4%12.5%$0.30$1.201M-230 Open 298c/s2.2sOct. 202570034.426.023.95.319.06.714.5-29.929.929.6---44.0%-------46.3%---36.0%--
OpenAI🇺🇸o1x78.0%-41.0%-$15.00$60.00200k-- Closed --Dec. 2024-24.727.67.4-17.119.615.4-42.542.637.7-87.7%77.6%-----47.0%---70.8%5.5%----
Qwen🇨🇳Qwen3-235B-A22B-Instruct-2507x77.5%70.3%--$0.15$0.80262.1k-235 Open --Jul. 202514728.629.27.2-13.513.18.5-35.235.736.9--------54.3%---------
OpenAI🇺🇸o3-minix77.2%-49.3%-$1.10$4.40200kSep. 2023- Closed --Jan. 2025-22.030.78.3-9.0--2.82.323.323.322.8--------15.0%---57.6%9.2%----
Qwen🇨🇳Qwen3-Next-80B-A3B-Thinkingx77.2%87.8%--$0.15$1.5065.5k-80 Open --Sep. 2025-30.232.2--16.118.414.1-34.833.535.1------------69.6%-----
Qwen🇨🇳Qwen3.5-4B✓76.2%-------4 Open --Mar. 2026-22.723.6--12.614.48.511.923.623.723.3-76.1%----------------
Nvidia🇺🇸Llama 3.1 Nemotron Ultra 253B v1x76.0%72.5%-----Dec. 2023253 Open --Apr. 2025-24.822.018.6---22.9----------------------
MoonshotAI🇨🇳Kimi K2 0905x75.8%---$0.60$2.50262.1k-1000 Closed 37c/s21.4sSep. 20251,00526.028.230.1-----35.135.134.6------------------
Anthropic🇺🇸Claude Sonnet 4✓75.4%70.5%72.7%------ Closed --May 202588230.622.121.8-25.316.823.5---25.8-86.5%74.4%--------35.5%80.5%-----
ZAI🇨🇳GLM-4.7-Flashx75.2%91.6%59.2%14.4%$0.07$0.40128k-30 Open 56c/s29.6sJan. 202675931.929.39.03.9-8.110.1-------42.8%--------------
MoonshotAI🇨🇳Kimi K2-Instruct-0905x75.1%49.5%65.8%4.7%----1000 Open --Sep. 2025-24.423.513.1-14.8-3.89.9-30.630.630.2--------31.0%--25.0%------
MoonshotAI🇨🇳Kimi K2 Instructx75.1%49.5%-4.7%$0.50$0.50200k-1000 Open --Jul. 2025-88225.725.717.3-16.1-5.411.4-31.431.531.0--------31.0%--30.0%------
Nvidia🇺🇸Nemotron 3 Nano (30B A3B)x75.0%99.2%38.8%15.5%$0.06$0.24262.1kNov. 202532 Open 96c/s10.2sDec. 202519324.928.22.9-5.410.91.2-18.118.217.8-----------8.5%---33.3%--
ZAI🇨🇳GLM-4.5-Airx75.0%-57.6%10.6%----106 Open --Jul. 2025-30.729.316.8-7.825.13.724.5-35.528.528.2---21.3%-------30.0%77.9%--37.3%--
DeepSeek🇨🇳DeepSeek-V3.1x74.9%49.8%66.0%15.9%$0.27$1.00163.8k-671 Open --Jan. 2025-28.623.417.03.3-11.7--34.134.133.9---30.0%----93.4%--31.3%------
Qwen🇨🇳Qwen3 VL 30B A3B Thinking✓74.4%83.1%--$0.20$1.00262.1k-31 Open --Sep. 2025-21.926.3--13.216.96.017.728.128.428.9----56.6%63.0%57.3%-23.9%30.6%--------
OpenAI🇺🇸GPT OSS 20B Highx74.2%98.7%------20.9 Open --Aug. 202523038.145.6---------------------------
Google🇺🇸Gemini 2.0 Flash Thinking✓74.2%------Aug. 2024- Closed --Jan. 2025-22.513.8---19.5----29.5--75.4%---------------
Inception🇺🇸Mercury 2x74.0%91.1%--$0.25$0.75128k-- Closed 886c/s1.0sFeb. 202612529.531.619.2-7.3-3.4-------------------38.0%--
Baidu🇨🇳ERNIE 4.5x74.0%---$0.40$4.00128k-21 Closed --Jun. 2025124-18.1-21.1-------22.3-22.3-22.6--------1.8%---------
DeepSeek🇨🇳DeepSeek R1 Zerox73.3%-------671 Open --Jan. 2025-21.423.78.1--------------------------
OpenAI🇺🇸o1-previewx73.3%-41.3%-$15.00$60.00128k-- Closed --Sep. 2024-20.123.21.7-----38.638.737.4--------42.4%---------
Meituan🇨🇳LongCat-Flash-Chatx73.2%61.3%60.4%-$0.30$1.20128k-560 Open 113c/s7.0sAug. 202577823.923.016.2-17.7-14.4-35.035.034.5-----------39.5%------
Qwen🇨🇳Qwen3 VL 32B Thinking✓73.1%83.7%------33 Open --Sep. 2025-28.530.3--18.922.312.020.534.133.933.5----65.2%68.1%57.1%-55.4%41.0%--------
Anthropic🇺🇸Claude Haiku 4.5✓73.0%80.7%73.3%-$1.00$5.00200kFeb. 2025- Closed 97c/s835msOct. 202584436.021.425.8-25.217.221.814.4---0.7-83.0%-------50.7%-41.0%------
Qwen🇨🇳Qwen3-Next-80B-A3B-Instructx72.9%69.5%--$0.15$1.5065.5k-80 Open --Sep. 2025-24.025.14.2-10.710.94.8-32.532.729.5------------60.9%-----
OpenAI🇺🇸GPT OSS 20Bx71.5%--10.9%$0.10$0.50131.1k-20.9 Open 209c/s8.4sAug. 202554720.322.6---5.14.1-7.2-16.716.722.6------------54.8%-----
OpenAI🇺🇸GPT-5 nano✓71.2%85.2%-8.7%---May 2024- Closed --Aug. 202566324.825.6---1.8------------------9.6%----
Mistral🇫🇷Ministral 3 (14B Reasoning 2512)✓71.2%85.0%--$0.20$0.20262.1k-14 Open --Dec. 2025-27.629.617.0--------------------------
Mistral🇫🇷Mistral Small 4✓71.2%83.8%--$0.15$0.60256k-119 Open 468c/s804msMar. 2026-11324.124.516.1--12.3-39.921.821.821.5-----60.0%------------
Mistral🇫🇷Magistral Medium✓70.8%64.9%-9.0%---Jun. 202524 Open --Jun. 2025-17.916.65.8--2.6-----------------------
Qwen🇨🇳Qwen3 VL 30B A3B Instruct✓70.4%69.3%--$0.20$0.70262.1k-31 Open --Sep. 2025-16.619.3--8.716.01.118.921.421.722.0----48.9%60.4%60.5%-27.0%30.3%--------
OpenAI🇺🇸GPT-4o✓70.1%-33.2%5.3%$2.50$10.00128k-- Closed --Aug. 2024-17.615.31.3-6.712.65.815.519.719.720.2-81.4%72.2%-58.8%59.9%--38.2%---60.3%-----
MiniMax🇨🇳MiniMax M1 80Kx70.0%76.9%56.0%8.4%$0.55$2.201M-456 Open --Jun. 2025-26.025.014.4-17.81.517.430.526.726.726.4--------18.5%---63.5%-----
Qwen🇨🇳Qwen3 VL 8B Thinking✓69.9%80.3%--$0.18$2.09262.1k-9 Open --Sep. 2025-18.922.1--15.115.2-11.013.421.423.421.5----53.0%60.4%46.6%-49.6%33.9%--------
Meta🇺🇸Llama 4 Maverick✓69.8%---$0.17$0.601M-400 Open --Apr. 2025-15.622.85.7--18.8--23.523.525.4--73.4%--59.6%------------
OpenAI🇺🇸GPT-4.5✓69.5%-38.0%-$75.00$150.00128k-- Closed --Feb. 2025-23.624.77.9-13.318.812.513.440.240.336.0-85.1%75.2%-55.4%---62.5%---68.4%-----
MiniMax🇨🇳MiniMax M1 40Kx69.2%74.6%55.6%7.2%----456 Open --Jun. 2025-24.822.712.8-17.10.615.732.925.725.725.4--------17.9%---67.8%-----
Microsoft🇺🇸Phi 4 Reasoning Plusx68.9%78.0%-----Mar. 202514 Open --Apr. 2025-18.422.49.8-----19.519.519.3------------------
Qwen🇨🇳Qwen3 VL 32B Instruct✓68.9%66.2%------33 Open --Sep. 2025-21.622.9--12.520.28.323.025.824.825.7----62.8%65.3%57.9%--32.6%--------
DeepSeek🇨🇳DeepSeek-V3 0324x68.4%---$0.28$1.14163.8k-671 Open --Mar. 2025-16.719.56.8-----28.428.328.1------------------
Mistral🇫🇷Magistral Small 2506x68.2%62.8%-----Jun. 202524 Open --Jun. 2025-14.812.58.7--------------------------
Anthropic🇺🇸Claude 3.5 Sonnet✓67.2%-49.0%-$3.00$15.00200k-- Closed --Oct. 2024-22.525.417.9-13.120.111.3-30.230.227.1--68.3%---------69.2%-----
Meituan🇨🇳LongCat-Flash-Litex66.8%63.2%54.4%-$0.10$0.40256k-68.5 Open 119c/s6.7sFeb. 202671223.220.012.3-18.6-15.3-22.322.321.9-----------33.8%------
Mistral🇫🇷Ministral 3 (8B Reasoning 2512)✓66.8%78.7%--$0.15$0.15262.1k-8 Open --Dec. 2025-22.624.714.3--------------------------
Nvidia🇺🇸Llama-3.3 Nemotron Super 49B v1x66.7%58.4%-----Dec. 202349.9 Open --Mar. 2025-15.916.8--27.8-16.4----------------------
Sarvam AI🇮🇳Sarvam-30Bx66.5%96.7%34.0%-----30 Open --Mar. 2026-24.128.612.01.9----22.022.021.7---35.5%--------------
OpenAI🇺🇸GPT-4.1✓66.3%46.4%54.6%5.4%$2.00$8.001.0MJun. 2024- Closed 259c/s1.5sApr. 202565721.820.38.2-10.615.312.120.233.333.432.0-87.3%74.8%-56.7%-------68.0%-----
Nous Research🇺🇸Hermes 3 70Bx66.1%-------70 Open --Aug. 202471-1.7-1.7--34.8---3.24.12.9------------------
Qwen🇨🇳Qwen3 30B A3Bx65.8%70.9%--$0.10$0.44128k-30.5 Open 250c/s303msApr. 20255818.219.815.3-7.9-16.9----------------------
Microsoft🇺🇸Phi 4 Reasoningx65.8%62.9%-----Mar. 202514 Open --Apr. 2025-15.216.611.3-----16.616.616.4------------------
DeepSeek🇨🇳DeepSeek R1 Distill Llama 70Bx65.2%---$0.10$0.40128k-70.6 Open --Jan. 2025-19.623.013.9--------------------------
Qwen🇨🇳QwQ-32Bx65.2%------Nov. 202432.5 Open --Mar. 2025-14.817.815.9---5.6----------------------
Qwen🇨🇳QwQ-32B-Previewx65.2%---$0.15$0.6032.8kNov. 202432.5 Open --Nov. 2024-11.211.17.1--------------------------
OpenAI🇺🇸GPT-4.1 mini✓65.0%40.2%23.6%3.7%$0.40$1.601.0MMay 2024- Closed 206c/s1.9sApr. 202596616.116.5-1.1-2.714.7-0.513.625.025.126.0-78.5%72.7%-56.8%-------55.8%-----
Google🇺🇸Gemini 2.5 Flash-Lite✓64.6%49.8%31.6%5.1%$0.10$0.401.0MJan. 2025- Open --Jun. 2025-12.910.3-2.1--9.1--13.7--23.0--72.9%-----10.7%---------
Qwen🇨🇳Qwen3 VL 4B Thinking✓64.1%74.5%--$0.10$1.00262.1k-4 Open --Sep. 2025-15.618.3--12.212.12.911.919.518.818.0----50.3%57.0%49.2%--31.4%--------
Nvidia🇺🇸Nemotron Nano 9B v2x64.0%72.1%-----Sep. 20248.9 Open --Aug. 2025-22.923.021.2--------------------------
DeepSeek🇨🇳DeepSeek R1 Distill Qwen 32Bx62.1%---$0.12$0.18128k-32.8 Open --Jan. 2025-17.320.413.3--------------------------
Google🇺🇸Gemini 2.0 Flash✓62.1%---$0.10$0.401.0MAug. 2024- Closed --Dec. 2024-16.626.53.2--13.7-16.120.020.022.7--70.7%---------------
Qwen🇨🇳Qwen3 Maxx62.0%81.6%69.6%-$0.50$5.00256k-1000 Closed 86c/s1.5sDec. 202563629.130.917.9---5.7-39.639.838.8------------------
OpenAI🇺🇸o1-minix60.0%---$3.00$12.00128k-- Closed --Sep. 2024-11.713.122.7-----17.017.116.6------------------
Anthropic🇺🇸Claude 3.5 Sonnet✓59.4%---$3.00$15.00200k-- Closed --Jun. 2024-18.526.521.7-----30.130.129.6------------------
DeepSeek🇨🇳DeepSeek R1 Distill Qwen 14Bx59.1%-------14.8 Open --Jan. 2025-14.116.910.1--------------------------
DeepSeek🇨🇳DeepSeek-V3x59.1%-42.0%-$0.27$1.10131.1k-671 Open --Dec. 2024-16.120.48.9----6.525.425.525.0--------24.9%---------
Google🇺🇸Gemini 1.5 Pro✓59.1%---$2.50$10.002.1MNov. 2023- Closed --May 2024-10.317.93.5--14.5-25.321.021.120.6--65.9%---------------
Google🇺🇸Gemma 4 E4B✓58.6%------Jan. 20258 Open --Apr. 2026-12.614.7---10.8-1.67.211.611.612.6-76.6%---52.6%------------
Meta🇺🇸Llama 4 Scout✓57.2%---$0.08$0.3010M-109 Open --Apr. 2025-6.214.3-0.5--15.4--12.812.915.8--69.4%---------------
Microsoft🇺🇸Phi 4x56.1%---$0.07$0.1416kJun. 202414.7 Open --Dec. 2024-4.913.72.2-----15.515.515.2--------3.0%---------
xAI🇺🇸Grok-2✓56.0%---$2.00$10.00128k-- Closed --Aug. 2024-12.420.913.6--13.3--23.723.822.4--66.1%---------------
Nvidia🇺🇸Llama 3.1 Nemotron Nano 8B V1x54.1%47.1%-----Dec. 20238 Open --Mar. 2025-6.012.7--7.3--1.8----------------------
OpenAI🇺🇸GPT-4o✓53.6%---$2.50$10.00128k-- Closed --May 2024-13.620.619.4--6.9--24.424.424.0------------------
Mistral🇫🇷Min istral 3 (3B Reasoning 2512)✓53.4%72.1%--$0.10$0.10131.1k-3 Open --Dec. 2025-15.017.211.4--------------------------
Microsoft🇺🇸Phi 4 Mini Reasoningx52.0%------Feb. 20253.8 Open --Apr. 2025-9.316.0---------------------------
Qwen🇨🇳Qwen3.5-2B✓51.6%-------2 Open --Mar. 2026--0.34.2---6.1-4.6-4.10.44.44.44.0-63.1%----------------
Google🇺🇸Gemini 2.0 Flash-Lite✓51.5%---$0.07$0.301.0MJun. 2024- Closed --Feb. 2025-12.420.7---6.2--2.513.713.816.9--68.0%-----21.7%---------
Google🇺🇸Gemini 1.5 Flash✓51.0%---$0.15$0.601.0MNov. 2023- Closed --May 2024-4.311.1-3.9--10.7-21.47.27.210.5--62.3%---------------
xAI🇺🇸Grok-2 mini✓51.0%-------- Closed --Aug. 2024-8.518.06.9--10.7--19.920.019.0--63.2%---------------
Meta🇺🇸Llama 3.1 405B Instructx50.7%---$0.89$0.89128k-405 Open --Jul. 2024-14.222.116.5---40.5-22.422.422.0------------------
Meta🇺🇸Llama 3.3 70B Instructx50.5%---$0.20$0.20128k-70 Open --Dec. 2024-12.419.713.2---29.2-17.417.417.0------------------
Anthropic🇺🇸Claude 3 Opus✓50.4%---$15.00$75.00200k-- Closed --Feb. 2024-9.017.65.5-----18.418.518.1------------------
OpenAI🇺🇸GPT-4.1 nano✓50.3%---$0.10$0.401.0MMay 2024- Closed --Apr. 2025-1.35.6-18.7--19.71.8-20.53.85.45.46.3-66.9%55.4%-40.5%-------22.6%-----
Qwen🇨🇳Qwen2.5 32B Instructx49.5%-------32.5 Open --Sep. 2024-5.418.112.4-----10.310.510.1------------------
DeepSeek🇨🇳DeepSeek R1 Distill Qwen 7Bx49.1%-------7.6 Open --Jan. 2025-11.318.74.3--------------------------
DeepSeek🇨🇳DeepSeek R1 Distill Llama 8Bx49.0%-------8.0 Open --Jan. 2025-8.413.44.9--------------------------
Qwen🇨🇳Qwen2.5 72B Instructx49.0%---$0.35$0.40131.1k-72.7 Open --Sep. 2024-12.219.611.7-31.0---13.513.513.3------------------
MoonshotAI🇨🇳Kimi K2 Basex48.1%-------1000 Open --Jul. 2025-13.916.217.2-----20.320.419.9--------35.3%---------
OpenAI🇺🇸GPT-4 Turbox48.0%---$10.00$30.00128kDec. 2023- Closed --Apr. 2024-9.320.18.6-----23.123.122.6------------------
Qwen🇨🇳Qwen3 235B A22Bx47.5%81.5%--$0.10$0.10128k-235 Open --Apr. 2025-15.922.216.2---22.3-18.218.217.8-86.7%----------------
Amazon🇺🇸Nova Pro✓46.9%---$0.80$3.20300k-- Closed --Nov. 2024-11.621.115.320.6-10.813.910.921.019.517.0--61.7%---------------
Meta🇺🇸Llama 3.2 90B Instruct✓46.7%---$0.35$0.40128k-90 Open --Sep. 2024-6.513.2---7.0--20.820.917.3--60.3%--45.2%------------
Mistral🇫🇷Mistral Small 3.2 24B Instruct✓46.1%------Oct. 202323.6 Open --Jun. 2025-7.612.3--9.015.2--11.511.613.2--62.5%-----12.1%---------
Mistral🇫🇷Mistral Small 3.1 24B Instruct✓46.0%-------24 Open --Mar. 2025-3.19.113.8--3.6--9.29.29.8--59.3%-----10.4%---------
Qwen🇨🇳Qwen2.5 VL 32B Instruct✓46.0%-------33.5 Open --Feb. 2025-8.212.719.6--10.7-10.27.67.712.6--70.0%--49.5%39.4%--5.9%--------
Qwen🇨🇳Qwen2.5 14B Instructx45.5%-------14.7 Open --Sep. 2024-1.011.12.9-----5.36.36.0------------------
Mistral🇫🇷Mistral Small 3 24B Instructx45.3%---$0.07$0.1432kOct. 202324 Open --Jan. 2025-2.88.84.6-10.0---5.15.14.9------------------
Mistral🇫🇷Mistral Large 3 (675B Instruct 2512)✓43.9%---$0.50$1.50262.1k-675 Open 181c/s5.6sDec. 20256268.319.90.1---------85.5%------23.8%---------
Mistral🇫🇷Mistral Large 3 (675B Base)✓43.9%-------675 Open --Dec. 2025-11.826.31.9---------85.5%------23.8%---------
Mistral🇫🇷Mistral Large 3 (675B Instruct 2512 Eagle)✓43.9%-------675 Open --Dec. 2025-10.524.01.3---------85.5%------23.8%---------
Mistral🇫🇷Mistral Large 3 (675B Instruct 2512 NVFP4)✓43.9%-------675 Open --Dec. 2025-9.322.00.7---------85.5%------23.8%---------
Google🇺🇸Gemma 4 E2B✓43.4%------Jan. 20255.1 Open --Apr. 2026-3.36.9---6.5-11.0-1.41.31.43.1-67.4%---44.2%------------
Google🇺🇸Gemma 3 27B✓42.4%---$0.10$0.20131.1k-27 Open --Mar. 2025-7.219.54.9---0.3--8.38.37.4--------10.0%---------
Qwen🇨🇳Qwen2 72B Instructx42.4%-------72 Open --Jul. 2024-3.711.511.8-----8.77.16.8------------------
Amazon🇺🇸Nova Lite✓42.0%---$0.06$0.24300k-- Closed --Nov. 2024-5.815.05.711.6-6.110.35.410.38.28.1--56.2%---------------
Meta🇺🇸Llama 3.1 70B Instructx41.7%---$0.20$0.20128k-70 Open --Jul. 2024-4.713.01.6---32.2-11.411.511.1------------------
Anthropic🇺🇸Claude 3.5 Haikux41.6%-40.6%-$0.80$4.00200k-- Closed --Oct. 2024-5.412.17.2--8.2--10.0-4.24.24.0------------51.0%-----
Google🇺🇸Gemma 3 12B✓40.9%---$0.05$0.10131.1k-12 Open --Mar. 2025-4.214.52.0---1.7--2.72.72.0--------6.3%---------
Anthropic🇺🇸Claude 3 Sonnet✓40.4%---$3.00$15.00200k-- Closed --Feb. 2024--0.57.8-5.0-----4.24.23.9------------------
Google🇺🇸Gemini Diffusionx40.4%23.3%22.9%------ Closed --May 2025-0.7-3.45.3--------------------------
OpenAI🇺🇸GPT-4o mini✓40.2%-8.7%-$0.15$0.60128kOct. 2023- Closed --Jul. 2024-3.212.81.3--3.9--12.212.312.4--59.4%---------------
Amazon🇺🇸Nova Microx40.0%---$0.03$0.14128k-- Closed --Nov. 2024--0.89.50.5-1.8---4.0-5.11.92.21.9------------------
Google🇺🇸Gemini 1.5 Flash 8B✓38.4%---$0.07$0.301.0MOct. 20248 Closed --Mar. 2024--2.12.3---1.3-16.01.61.63.9--53.7%---------------
Mistral🇫🇷Mistral Small 3.1 24B Base✓37.5%---$0.10$0.30128k-24 Open --Mar. 2025--1.05.7---4.2--6.76.88.5--59.3%---------------
AI21 Labs🇮🇱Jamba 1.5 Largex36.9%---$2.00$8.00256kMar. 2024398 Open --Aug. 2024--1.14.9---0.2---6.16.25.8------------------
Microsoft🇺🇸Phi-3.5-MoE-instructx36.8%-------60 Open --Aug. 2024--1.74.0-8.3----16.23.93.93.6-69.9%----------------
Qwen🇨🇳Qwen2.5 7B Instructx36.4%---$0.30$0.30131.1k-7.6 Open --Sep. 2024-0.78.71.7-21.5---0.70.70.5------------------
xAI🇺🇸Grok-1.5x35.9%-------- Closed --Mar. 2024--4.45.3-4.7---1.9--6.16.15.7--53.6%---------------
OpenAI🇺🇸GPT-4✓35.7%---$30.00$60.0032.8kDec. 2022- Closed --Jun. 2023-0.09.7-9.6-----22.622.622.1------------------
Mistral🇫🇷Mistral Small 3 24B Base✓34.4%------Oct. 202323.6 Open --Jan. 2025--3.14.0------6.39.26.0------------------
DeepSeek🇨🇳DeepSeek R1 Distill Qwen 1.5Bx33.8%-------1.8 Open --Jan. 2025--3.97.5-7.6--------------------------
Anthropic🇺🇸Claude 3 Haiku✓33.3%---$0.25$1.25200k-- Closed --Mar. 2024--4.24.2-1.8-----0.30.3-0.1------------------
Meta🇺🇸Llama 3.2 11B Instruct✓32.8%---$0.05$0.05128kDec. 202310.6 Open --Sep. 2024--3.01.2---2.7---1.6-1.6-0.9--50.7%--33.0%------------
Meta🇺🇸Llama 3.2 3B Instructx32.8%---$0.01$0.02128k-3.2 Open --Sep. 2024--10.4-5.4----8.4--13.9-13.9-14.3------------------
AI21 Labs🇮🇱Jamba 1.5 Minix32.3%---$0.20$0.40256.1kMar. 202452 Open --Aug. 2024--8.9-5.8---9.5----5.7-5.7-6.0------------------
Google🇺🇸Gemma 3 4B✓30.8%---$0.02$0.04131.1kAug. 20244 Open --Mar. 2025--6.25.3-10.3---12.3---9.8-9.7-9.8--------4.0%---------
OpenAI🇺🇸GPT-3.5 Turbox30.8%---$0.50$1.5016.4kSep. 2021- Closed --Mar. 2023--12.4-3.7-10.0---20.0---5.2-5.2-8.2--0.0%---------------
Qwen🇨🇳Qwen2.5-Omni-7B✓30.8%-------7 Open --Mar. 2025--0.95.3-1.6--11.39.1-1.9-6.9-6.91.4--59.2%--36.6%------------
Meta🇺🇸Llama 3.1 8B Instructx30.4%---$0.03$0.03131.1kDec. 20238 Open --Jul. 2024--7.1-3.8-6.2---23.9--4.1-4.1-4.3------------------
Microsoft🇺🇸Phi-3.5-mini-instructx30.4%---$0.10$0.10128k-3.8 Open --Aug. 2024--8.9-3.2-13.5----14.4-0.4-0.3-0.6-55.4%----------------
Google🇺🇸Gemini 1.0 Prox27.9%---$0.50$1.5032.8kFeb. 2024- Closed --Feb. 2024--12.2-3.3----7.3--12.2-2.7-2.7-3.1--47.9%---------------
Qwen🇨🇳Qwen2 7B Instructx25.3%-------7.6 Open --Jul. 2024--7.4-2.7-1.3-15.6----6.4-5.1-5.3------------------
Microsoft🇺🇸Phi 4 Minix25.2%------Jun. 20243.8 Open --Feb. 2025--8.31.8------0.70.70.4------------------
Google🇺🇸Gemma 3n E2B Instructed✓24.8%6.7%-----Jun. 20248 Closed --Jun. 2025--15.4-10.5-8.6------13.9-13.9-14.2------------------
Google🇺🇸Gemma 3n E2B Instructed LiteRT (Preview)✓24.8%6.7%-----Jun. 20241.9 Open --May 2025--17.5-12.4-11.0-16.8-----17.3-17.3-17.6------------------
Google🇺🇸Gemma 3n E4B Instructed✓23.7%11.6%--$20.00$40.0032kJun. 20248 Closed --Jun. 2025--8.4-2.0-3.7------5.5-5.5-5.7------------------
Google🇺🇸Gemma 3n E4B Instructed LiteRT Preview✓23.7%11.6%-----Jun. 20241.9 Open --May 2025--11.3-3.5-5.72.7-----7.0-7.0-7.2------------------
Google🇺🇸Gemma 3 1Bx19.2%-------1 Open --Mar. 2025--20.7-12.7-18.5------27.8-27.8-28.1--------2.2%---------
Qwen🇨🇳Qwen3.5-0.8B✓11.9%-------0.8 Open --Mar. 2026--15.1-8.3---12.7-18.2-20.8-15.3-7.5-7.5-7.7-44.3%----------------
ZAI🇨🇳GLM-5x--77.8%-$1.00$3.20200k-744 Open 86c/s9.6sFeb. 20261,57652.1-37.326.5--26.7-------75.9%---67.8%----------
OpenAI🇺🇸GPT-5.3 Codex✓----$1.75$14.00400k-- Closed 172c/s1.8sFeb. 20261,24456.2-43.9--27.937.2---------------------56.8%
OpenAI🇺🇸GPT-5.2 Codex✓----$1.75$14.00400k-- Closed 135c/s2.2sJan. 20261,14852.6-40.2---27.6---------------------56.4%
MiniMax🇨🇳MiniMax M2.5x--80.2%-$0.30$1.201M-230 Open 200c/s4.2sFeb. 202696753.4-38.927.0-----1.6-----76.3%-------------55.4%
xAI🇺🇸Grok-4.20 Beta Non-Reasoning✓----$2.00$6.002M-- Closed 219c/s1.9sMar. 2026914-------13.6---------------------
OpenAI🇺🇸GPT-5.1 Medium✓-98.4%--$1.25$10.00400k-- Closed 239c/s15.5sNov. 202586046.044.4---------------------------
DeepSeek🇨🇳DeepSeek-V3.2-Specialex-96.0%73.1%30.6%----685 Open --Dec. 202583243.046.223.5--25.513.1--------------35.2%-------
DeepSeek🇨🇳DeepSeek-V3.2 (Non-thinking)x----$0.28$0.42131.1k-685 Open --Dec. 2025703-----------------------------
OpenAI🇺🇸GPT-5.1 Codex High✓-96.7%--$1.25$10.00400k-- Closed 184c/s29.6sNov. 202569544.442.8---------------------------
OpenAI🇺🇸GPT-5.1 Codex✓--73.7%-$1.25$10.00400kSep. 2024- Closed 222c/s6.9sNov. 202568743.3-29.4---17.6----------------------
xAI🇺🇸Grok-4.20 Multi-Agent Beta✓--------- Closed --Mar. 2026660-----------------------------
StepFun🇨🇳Step-3.5-Flashx-97.3%74.4%-$0.10$0.4065.5k-196 Open 109c/s7.3sFeb. 202658749.947.128.922.4--19.1-------69.0%--------------
Qwen🇨🇳Qwen3-Coderx----$0.18$0.18256k-480 Open 105c/s1.1sJan. 2025580-----------------------------
xAI🇺🇸Grok-4 Fast Reasoning✓----$0.20$0.502M-- Closed 276c/s3.4sAug. 2025557-----------------------------
MiniMax🇨🇳MiniMax M2.7x----$0.30$1.20204.8k-- Open 145c/s2.9sMar. 202655553.6-40.1---24.3-31.231.5-----------46.3%------56.2%
xAI🇺🇸Grok-4.1 Fast Non-Reasoning✓----$0.20$0.502M-- Closed 460c/s1.1sNov. 2025533-----------------------------
xAI🇺🇸Grok-4.1 Fast Reasoning✓----$0.20$0.502M-- Closed 193c/s20.0sNov. 2025532-----------------------------
xAI🇺🇸Grok-4.20 Beta Reasoning✓----$2.00$6.002M-- Closed 146c/s21.5sMar. 2026494-------29.8---------------------
xAI🇺🇸Grok-4 Fast Non-Reasoning✓----$0.20$0.502M-- Closed 444c/s628msAug. 2025468-----------------------------
xAI🇺🇸Grok Code Fast 1x--70.8%-$0.20$1.50256k-- Closed 234c/s4.4sAug. 202543732.6-19.8--------------------------
OpenAI🇺🇸GPT-5.3 Chat✓----$1.75$14.00128kAug. 2025- Closed 267c/s1.5sMar. 2026404----------27.8------------------
Qwen🇨🇳Qwen3 32Bx-72.9%--$0.10$0.30128k-32.8 Open 249c/s1.1sApr. 202530018.922.513.1---19.6----------------------
Xiaomi🇨🇳MiMo-V2-Prox--78.0%-$1.00$3.001M-1000 Closed --Mar. 202621551.8-35.433.128.3-26.3-26.927.0-------------------
OpenAI🇺🇸GPT-5.1 Codex Mini✓-42.1%------- Closed --Nov. 20252100.81.1---------------------------
Xiaomi🇨🇳MiMo-V2-Omni✓--74.8%-$0.40$2.00262k-- Closed --Mar. 202619145.6-28.6-----24.424.5-------------------
Qwen🇨🇳Qwen3-Coder 480B A35B Instructx--69.6%-----480 Open --Jan. 20254627.4-16.8-21.6-14.5-22.6--------------77.5%-----
Mistral🇫🇷Codestral-22Bx--------22.2 Open --May 2024--1.3-1.0--------------------------
Cohere🇨🇦Command R+x----$0.25$1.00128k-104 Open --Aug. 2024--3.2-3.1------1.21.20.8------------------
DeepSeek🇨🇳DeepSeek-R1x----$0.55$2.19131.1k-671 Open --Jan. 2025------------------------------
DeepSeek🇨🇳DeepSeek-V2.5x--16.8%-$0.14$0.288.2k-236 Open --May 2024-8.215.910.7-24.5---7.77.87.4------------------
DeepSeek🇨🇳DeepSeek VL2✓--------27 Open --Dec. 2024--2.29.9---5.7-----1.1--51.1%---------------
DeepSeek🇨🇳DeepSeek VL2 Small✓--------16 Open --Dec. 2024--5.07.2---3.9-----3.5--48.0%---------------
DeepSeek🇨🇳DeepSeek VL2 Tiny✓--------3 Open --Dec. 2024--13.30.8----2.2-----9.5--40.7%---------------
Mistral🇫🇷Devstral Mediumx--61.6%-$0.40$2.00128k-- Closed --Jul. 2025-24.1-11.3--------------------------
Mistral🇫🇷Devstral Small 1.1x--53.6%-$0.10$0.30128k-24 Open --Jul. 2025-18.0-5.5--------------------------
Google🇺🇸Gemma 2 27Bx--------27.2 Open --Jun. 2024--4.7-2.2-14.623.8-----0.31.4-0.7------------------
Google🇺🇸Gemma 2 9Bx--------9.2 Open --Jun. 2024--8.7-5.4-18.813.5-----2.7-1.1-3.0------------------
Google🇺🇸Gemma 3n E2B✓-------Jun. 20248 Closed --Jun. 2025--14.7-8.6--3.6-------------------------
Google🇺🇸Gemma 3n E4B✓-------Jun. 20248 Closed --Jun. 2025--9.1-3.2-8.7-------------------------
ZAI🇨🇳GLM-5V-Turbo✓--------- Closed --Apr. 2026-12.7----27.8--------------62.3%--------
OpenAI🇺🇸GPT-5.5 Pro NEW✓---57.2%$30.00$180.001M-- Closed --Apr. 2026-62.051.6-43.2-42.4--10.6-----90.1%---------39.6%----
OpenAI🇺🇸GPT-5 Codexx--74.5%----Sep. 2024- Closed --Sep. 2025-40.8-27.7--------------------------
IBM🇺🇸Granite 3.3 8B Base✓-------Apr. 20248.2 Open --Apr. 2025--2.9-1.618.2------9.8-8.6-10.2------------------
IBM🇺🇸IBM Granite 4.0 Tiny Previewx--------7 Open --May 2025--9.4-8.41.3------5.9-5.8-6.2------------------
xAI🇺🇸Grok-1.5V✓--------- Closed --Apr. 2024-0.4-1.6---1.6----1.1--53.6%---------------
xAI🇺🇸Grok-2 Image 1212x--------- Closed --Dec. 2024------------------------------
xAI🇺🇸Grok-4.1✓----$3.00$15.00256k-- Closed --Nov. 2025------------------------------
xAI🇺🇸Grok-4.1 Thinking✓----$3.00$15.00256k-- Closed --Nov. 2025-------1.2-----2.0------------------
MoonshotAI🇨🇳Kimi-k1.5✓--------- Closed --Jan. 2025-19.824.0---18.6--25.225.324.1--70.0%---------------
Nvidia🇺🇸Llama 3.1 Nemotron 70B Instructx-------Dec. 202370 Open --Oct. 2024--1.88.3---5.2---6.96.96.6------------------
Google🇺🇸MedGemma 4B IT✓--------4.3 Open --May 2025--10.3-----7.3-----8.4------------------
OpenBMB🇨🇳MiniCPM-SALAx-78.3%------9.5 Open --Feb. 2026-16.517.633.1-----6.66.76.4------------------
Mistral🇫🇷Ministral 3 (14B Base 2512)✓--------14 Open --Dec. 2025-2.310.3------5.48.15.1------------------
Mistral🇫🇷MiniStral 3 (14B Instruct 2512)✓--------14 Open --Dec. 2025-13.629.7--12.5------------------------
Mistral🇫🇷Ministral 3 (3B Base 2512)✓--------3 Open --Dec. 2025--9.8-1.4-------3.3-3.0-3.6------------------
Mistral🇫🇷Ministral 3 (3B Instruct 2512)✓--------3 Open --Dec. 2025-1.819.3--3.9------------------------
Mistral🇫🇷Ministral 3 (8B Base 2512)✓--------8 Open --Dec. 2025--3.64.5------1.24.60.9------------------
Mistral🇫🇷Ministral 3 (8B Instruct 2512)✓--------8 Open --Dec. 2025-8.724.8--8.2------------------------
Mistral🇫🇷Ministral 8B Instructx----$0.10$0.10128k-8.0 Open --Oct. 2024--7.4-5.0-23.4-10.2----10.0-10.8-10.3------------------
Mistral🇫🇷Mistral Large 2x----$2.00$6.00128k-123 Open --Jul. 2024-8.514.121.1-19.5---15.115.214.7------------------
Mistral🇫🇷Mistral Large 3✓----$2.00$5.00128k-675 Open --Sep. 2025-7.116.6--20.5-------74.2%----------------
Mistral🇫🇷Mistral NeMo Instructx----$0.15$0.15128k-12 Open --Jul. 2024--8.3-8.0-18.3-----10.3-10.4-10.7------------------
Mistral🇫🇷Mistral Smallx----$0.20$0.6032.8k-22 Open --Sep. 2024------------------------------
OpenAI🇺🇸o3-pro✓----$20.00$80.00200kMay 2024- Closed --Jun. 2025------------------------------
Microsoft🇺🇸Phi-3.5-vision-instruct✓--------4.2 Open --Aug. 2024--6.4-8.2----1.9-----6.8--43.0%---------------
Microsoft🇺🇸Phi-4-multimodal-instruct✓----$0.05$0.10128kJun. 20245.6 Open --Feb. 2025--1.59.1---5.3----3.9--55.1%--38.5%------------
Mistral🇫🇷Pixtral-12B✓----$0.15$0.15128k-12.4 Open --Sep. 2024--5.91.0-6.7-5.83.4---6.0-6.0-2.1--52.5%---------------
Mistral🇫🇷Pixtral Large✓----$2.00$6.00128k-124 Open --Nov. 2024-16.217.2--7.016.2----14.9--64.0%---------------
Qwen🇨🇳QvQ-72B-Preview✓--------73.4 Open --Dec. 2024-12.112.6---12.6----20.1--70.3%---------------
Qwen🇨🇳Qwen2.5-Coder 32B Instructx----$0.09$0.09128k-32 Open --Sep. 2024-0.34.813.0-----0.4-1.3-1.6------------------
Qwen🇨🇳Qwen2.5-Coder 7B Instructx--------7 Open --Sep. 2024--6.2-4.46.8------8.9-10.6-10.9------------------
Qwen🇨🇳Qwen2.5 VL 72B Instruct✓--------72 Open --Jan. 2025-13.610.3---13.6-14.9--20.0--70.2%--51.1%43.6%--8.8%--------
Qwen🇨🇳Qwen2.5 VL 7B Instruct✓--------8.3 Open --Jan. 2025-2.35.8---8.4-6.4--6.2--58.6%--38.3%29.0%-----------
Qwen🇨🇳Qwen2-VL-72B-Instruct✓-------Jun. 202373.4 Open --Aug. 2024-15.48.2---16.5-21.1--4.1-----46.2%------------
Qwen🇨🇳Qwen3-Next-80B-A3B-Basex--------80 Open --Sep. 2025------------------------------
Qwen🇨🇳Qwen3 VL 235B A22B Instruct✓-74.7%--$0.30$1.50262.1k-236 Open --Sep. 2025-26.628.8--19.423.94.723.832.534.132.7----62.1%68.1%62.0%-51.9%66.7%--------
Qwen🇨🇳Qwen3 VL 235B A22B Thinking✓-89.7%-13.6%$0.45$3.49262.1k-236 Open --Sep. 2025-32.235.7--20.923.513.219.739.640.339.5----66.1%69.3%61.8%-44.4%38.1%--------
Qwen🇨🇳Qwen3 VL 4B Instruct✓-46.6%--$0.10$0.60262.1k-4 Open --Sep. 2025-8.69.0--6.011.3-4.814.610.89.98.0----39.7%53.2%59.5%-48.0%26.2%--------
Qwen🇨🇳Qwen3 VL 8B Instruct✓-45.9%--$0.08$0.50262.1k-9 Open --Sep. 2025-12.313.9--11.914.4-1.316.117.217.115.6----46.4%55.9%54.6%--33.9%--------
StepFun🇨🇳Step3-VL-10B✓-87.7%------10 Open --Jan. 2026-35.330.7--26.623.9----32.2--78.1%---------------
ZAI🇨🇳GLM-4.5V✓--------108 Open --Aug. 2025-45-----------------------------
LG AI Research🇰🇷K-EXAONE-236B-A23Bx-92.8%--$0.60$1.0032.8kOct. 2025236 Closed --Dec. 2025-6535.134.6----4.3-36.536.536.3-85.7%----------------
IBM🇺🇸Granite 3.3 8B Instruct✓----$0.50$0.50128kApr. 20248 Open --Apr. 2025-1830.41.617.7-----0.60.70.3------------------