This site is currently in Beta testing. It may lack some features and be a bit buggy. Data loss may occur. We'd love to hear your feedback!
Copilot Arena
Compare how well AI coding assistants understand and generate code across various programming languages and tasks.
Learn more about Copilot Arena at our blog.
Last Updated
Apr 24, 2025
Total Votes
22,278
Total Models
13
/
/
| 1 | deepseek-coder-fim | 1029 | +14/-14 | 2,292 | Deepseek AI | Deepseek |
| 1 | claude-3-5-sonnet-20240620 | 1017 | +12/-12 | 3,119 | Anthropic | Proprietary |
| 1 | claude-3-5-sonnet-20241022 | 1005 | +13/-10 | 3,203 | Anthropic | Proprietary |
| 1 | codestral-2501 | 1000 | +17/-17 | 1,485 | Mistral | Mistral AI Non-Production |
| 2 | codestral-2405 | 1000 | +7/-8 | 5,172 | Mistral | Mistral AI Non-Production |
| 2 | anonymous-titan | 994 | +18/-18 | 1,429 | Inception AI | Unreleased |
| 3 | gpt-4o-2024-08-06 | 983 | +12/-11 | 4,003 | OpenAI | Proprietary |
| 4 | gemini-1.5-pro-002 | 984 | +8/-12 | 3,033 | Google | Proprietary |
| 4 |  llama-3.1-405b-instruct | 984 | +10/-11 | 3,432 | Meta | Llama 3.1 Community |
| 5 | gemini-1.5-flash-002 | 979 | +11/-10 | 4,592 | Google | Proprietary |
| 6 | llama-3.1-70b-instruct | 970 | +10/-8 | 4,085 | Meta | Llama 3.1 Community |
| 12 |  qwen-2.5-coder-32b-instruct | 951 | +7/-11 | 4,400 | Alibaba | Apache 2.0 |
| 12 | gpt-4o-mini-2024-07-18 | 942 | +12/-11 | 4,312 | OpenAI | Proprietary |