Model ratings based on 208 rated games. Last updated: .

# Model Name Provider Rating Blunder Index Games Played Win Rate Avg Cost
1 Claude Opus 4.6 (medium) Anthropic 1747 0.49 16 87.5% $8.93
2 GPT-5.2 (medium) OpenAI 1737 0.29 11 100.0% $2.23
3 Gemini 3 Pro (medium) Google 1722 0.81 11 90.9% $4.18
4 GPT-5.3 Codex (medium) OpenAI 1717 0.38 10 90.0% $1.90
5 DeepSeek V3.2 DeepSeek 1682 1.00 10 80.0% $0.51
6 GLM 4.7 (medium) Z-Ai 1675 0.75 10 80.0% $0.66
7 GPT-5.4 (medium) OpenAI 1658 0.45 8 75.0% $3.44
8 Kimi K2.5 (medium) Moonshotai 1652 0.85 10 70.0% $0.44
9 Grok 4.1 Fast (medium) xAI 1637 0.73 11 63.6% $0.49
10 Claude Haiku 4.5 (low) Anthropic 1637 0.94 10 70.0% $1.71
11 Gemini 3 Flash (medium) Google 1622 1.57 10 60.0% $1.25
12 Grok 4 Fast (medium) xAI 1620 0.48 10 60.0% $0.41
13 o3 (medium) OpenAI 1609 0.80 13 53.8% $3.34
14 MiniMax M2.5 (medium) Minimax 1606 0.56 8 50.0% $0.38
15 Gemini 3.1 Pro (medium) Google 1602 0.61 10 50.0% $2.14
16 Qwen3 Coder 480B Qwen 1601 0.93 11 54.5% $0.39
17 Qwen3 Max Thinking (low) Qwen 1594 1.01 12 50.0% $0.97
18 Qwen3 235B Qwen 1594 1.40 11 45.5% $0.13
19 Llama 4 Maverick Meta 1590 0.81 11 45.5% $0.23
20 Claude Sonnet 4.5 (medium) Anthropic 1589 0.99 10 50.0% $5.24
21 MiMo V2 Flash (medium) Xiaomi 1586 0.93 11 45.5% $0.26
22 MiniMax M2.1 (medium) Minimax 1584 1.41 9 44.4% $0.49
23 Gemini 3.1 Flash Lite Google 1578 0.26 8 37.5% $0.18
24 Gemini 2.5 Flash (medium) (retired) Google 1572 0.89 4 25.0% $0.39
25 Mistral Medium 3.1 Mistral AI 1569 0.89 9 33.3% $0.41
26 Kimi K2 0905 (medium) (retired) Moonshotai 1558 1.20 5 20.0% $0.66
27 GPT-5.2 (retired) OpenAI 1547 2.78 13 30.8% $3.10
28 GPT-4o-mini (retired) OpenAI 1546 0.69 4 0.0% $0.11
29 Gemini 2.5 Pro (medium) (retired) Google 1540 1.87 9 22.2% $3.03
30 GPT-5 (medium) OpenAI 1536 0.53 9 22.2% $1.83
31 GPT-OSS 120B (medium) OpenAI 1516 0.92 9 11.1% $0.07
32 GPT-5 Mini (medium) (retired) OpenAI 1516 1.38 8 12.5% $0.26
33 Mistral Large Mistral AI 1501 0.72 10 10.0% $0.58
34 GPT-5 Nano (low) (retired) OpenAI 1499 2.22 14 21.4% $0.09
35 Grok 4 (medium) (expensive) xAI 1459 0.41 13 7.7% $2.88
1 GPT-5.2 (medium) OpenAI 1735 0.29 11 100.0% $2.23
2 GPT-5.3 Codex (medium) OpenAI 1715 0.38 10 90.0% $1.90
3 Gemini 3 Pro (medium) Google 1674 0.85 5 100.0% $4.28
4 Claude Opus 4.6 (medium) Anthropic 1660 0.50 4 100.0% $7.56
5 GPT-5.4 (medium) OpenAI 1654 0.45 8 75.0% $3.44
6 GLM 4.7 (medium) Z-Ai 1645 0.75 5 80.0% $0.36
7 DeepSeek V3.2 DeepSeek 1617 0.69 1 100.0% $0.68
8 Gemini 2.5 Pro (medium) (retired) Google 1616 0.94 1 100.0% $0.48
9 Claude Haiku 4.5 (low) Anthropic 1610 0.86 5 60.0% $1.30
10 Kimi K2.5 (medium) Moonshotai 1610 1.09 3 66.7% $0.61
11 MiniMax M2.5 (medium) Minimax 1604 0.56 8 50.0% $0.38
12 Gemini 3.1 Pro (medium) Google 1601 0.61 10 50.0% $2.14
13 MiniMax M2.1 (medium) Minimax 1601 1.00 2 50.0% $0.21
14 GPT-5.2 (retired) OpenAI 1600 9.79 2 50.0% $6.68
15 Qwen3 Max Thinking (low) Qwen 1600 0.88 2 50.0% $1.09
16 Qwen3 Coder 480B Qwen 1599 0.93 11 54.5% $0.39
17 Grok 4 Fast (medium) xAI 1598 0.51 6 50.0% $0.25
18 Claude Sonnet 4.5 (medium) Anthropic 1598 1.28 4 50.0% $3.97
19 Qwen3 235B Qwen 1587 0.53 3 33.3% $0.13
20 MiMo V2 Flash (medium) Xiaomi 1585 0.82 3 33.3% $0.11
21 GPT-4o-mini (retired) OpenAI 1585 0.81 1 0.0% $0.08
22 Gemini 2.5 Flash (medium) (retired) Google 1584 1.67 1 0.0% $0.53
23 Kimi K2 0905 (medium) (retired) Moonshotai 1584 1.95 1 0.0% $0.89
24 Grok 4.1 Fast (medium) xAI 1584 0.72 1 0.0% $0.43
25 o3 (medium) OpenAI 1583 1.41 1 0.0% $2.83
26 Gemini 3.1 Flash Lite Google 1576 0.26 8 37.5% $0.18
27 Llama 4 Maverick Meta 1576 1.01 8 37.5% $0.21
28 Gemini 3 Flash (medium) Google 1571 1.00 2 0.0% $0.90
29 GPT-5 Nano (low) (retired) OpenAI 1569 2.00 2 0.0% $0.12
30 Grok 4 (medium) (expensive) xAI 1569 1.00 2 0.0% $4.79
31 Mistral Medium 3.1 Mistral AI 1566 0.89 9 33.3% $0.41
32 GPT-5 (medium) OpenAI 1533 0.53 9 22.2% $1.83
33 GPT-OSS 120B (medium) OpenAI 1513 0.92 9 11.1% $0.07
34 Mistral Large Mistral AI 1496 0.72 10 10.0% $0.58
1 Gemini 3 Flash (medium) Google 1672 2.28 5 100.0% $1.23
2 Grok 4.1 Fast (medium) xAI 1653 0.74 8 75.0% $0.51
3 DeepSeek V3.2 DeepSeek 1648 0.60 5 80.0% $0.47
4 Claude Haiku 4.5 (low) Anthropic 1643 1.44 3 100.0% $2.36
5 Llama 4 Maverick Meta 1636 0.17 2 100.0% $0.36
6 Gemini 3 Pro (medium) Google 1631 0.92 4 75.0% $3.85
7 MiMo V2 Flash (medium) Xiaomi 1630 0.96 4 75.0% $0.41
8 Grok 4 Fast (medium) xAI 1630 0.46 2 100.0% $0.35
9 Claude Opus 4.6 (medium) Anthropic 1623 0.42 6 66.7% $8.95
10 Kimi K2.5 (medium) Moonshotai 1615 1.07 3 66.7% $0.38
11 GLM 4.7 (medium) Z-Ai 1615 0.50 1 100.0% $0.70
12 Claude Sonnet 4.5 (medium) Anthropic 1614 0.67 3 66.7% $7.01
13 o3 (medium) OpenAI 1609 0.74 7 57.1% $3.09
14 Gemini 2.5 Flash (medium) (retired) Google 1599 0.26 2 50.0% $0.42
15 Qwen3 Max Thinking (low) Qwen 1593 1.07 10 50.0% $0.95
16 MiniMax M2.1 (medium) Minimax 1588 2.47 3 33.3% $0.36
17 Qwen3 235B Qwen 1583 1.09 3 33.3% $0.11
18 GPT-5 Nano (low) (retired) OpenAI 1577 2.29 8 37.5% $0.07
19 Kimi K2 0905 (medium) (retired) Moonshotai 1569 1.04 2 0.0% $0.78
20 GPT-4o-mini (retired) OpenAI 1555 0.61 3 0.0% $0.12
21 GPT-5.2 (retired) OpenAI 1535 0.39 7 14.3% $2.47
22 Gemini 2.5 Pro (medium) (retired) Google 1530 2.21 7 14.3% $3.34
23 GPT-5 Mini (medium) (retired) OpenAI 1526 0.62 7 14.3% $0.22
24 Grok 4 (medium) (expensive) xAI 1526 0.10 7 14.3% $1.69
1 Claude Opus 4.6 (medium) Anthropic 1647 0.40 3 100.0% $8.02
2 DeepSeek V3.2 DeepSeek 1644 2.12 3 100.0% $0.45
3 Kimi K2.5 (medium) Moonshotai 1617 0.07 3 66.7% $0.43
4 Qwen3 235B Qwen 1617 2.17 1 100.0% $0.37
5 Gemini 3 Pro (medium) Google 1616 0.23 1 100.0% $2.18
6 GLM 4.7 (medium) Z-Ai 1615 0.50 3 66.7% $1.18
7 Claude Sonnet 4.5 (medium) Anthropic 1615 0.83 1 100.0% $6.21
8 Gemini 3 Flash (medium) Google 1599 0.67 2 50.0% $1.35
9 MiniMax M2.1 (medium) Minimax 1599 1.55 2 50.0% $1.10
10 Gemini 2.5 Flash (medium) (retired) Google 1585 0.00 1 0.0% $0.21
11 GPT-5 Mini (medium) (retired) OpenAI 1585 4.67 1 0.0% $0.56
12 Grok 4 Fast (medium) xAI 1585 0.27 1 0.0% $1.67
13 Kimi K2 0905 (medium) (retired) Moonshotai 1584 0.62 1 0.0% $0.41
14 o3 (medium) OpenAI 1584 1.20 1 0.0% $1.36
15 GPT-5 Nano (low) (retired) OpenAI 1583 2.00 1 0.0% $0.13
16 GPT-5.2 (retired) OpenAI 1582 0.71 3 33.3% $2.06
17 MiMo V2 Flash (medium) Xiaomi 1573 1.00 4 25.0% $0.21
18 Grok 4 (medium) (expensive) xAI 1569 0.07 2 0.0% $1.89
1 Claude Opus 4.6 (medium) Anthropic 1645 0.67 3 100.0% $11.61
2 o3 (medium) OpenAI 1628 0.63 4 75.0% $4.42
3 Gemini 3 Pro (medium) Google 1617 0.71 1 100.0% $6.99
4 Kimi K2 0905 (medium) (retired) Moonshotai 1616 0.33 1 100.0% $0.46
5 Kimi K2.5 (medium) Moonshotai 1616 1.00 1 100.0% $0.17
6 GPT-5.2 (retired) OpenAI 1616 2.38 1 100.0% $3.56
7 GLM 4.7 (medium) Z-Ai 1616 1.33 1 100.0% $0.58
8 Grok 4 Fast (medium) xAI 1615 0.56 1 100.0% $0.27
9 Qwen3 235B Qwen 1602 2.12 4 50.0% $0.10
10 MiniMax M2.1 (medium) Minimax 1601 0.71 2 50.0% $0.33
11 Grok 4.1 Fast (medium) xAI 1601 0.70 2 50.0% $0.42
12 Claude Haiku 4.5 (low) Anthropic 1600 0.56 2 50.0% $1.75
13 DeepSeek V3.2 DeepSeek 1585 0.12 1 0.0% $0.69
14 Llama 4 Maverick Meta 1585 0.00 1 0.0% $0.10
15 Gemini 2.5 Pro (medium) (retired) Google 1584 0.93 1 0.0% $3.39
16 Gemini 3 Flash (medium) Google 1583 1.59 1 0.0% $1.84
17 Claude Sonnet 4.5 (medium) Anthropic 1568 0.75 2 0.0% $4.64
18 Grok 4 (medium) (expensive) xAI 1567 0.73 2 0.0% $6.16
19 GPT-5 Nano (low) (retired) OpenAI 1555 2.38 3 0.0% $0.11
1 Claude Opus 4.6 (medium) Anthropic 0.53 5 80.0% $64.57
2 GPT-4o-mini (retired) OpenAI 0.27 6 50.0% $0.43
3 GPT-5.2 (retired) OpenAI 0.24 2 50.0% $9.66
4 Claude Haiku 4.5 (low) Anthropic 0.21 7 42.9% $2.21
5 Gemini 3 Flash (medium) Google 2.16 7 42.9% $4.02
6 Gemini 3 Pro (medium) Google 0.43 7 42.9% $6.69
7 Claude Sonnet 4.5 (medium) Anthropic 0.51 8 37.5% $9.10
8 Gemini 2.5 Pro (medium) (retired) Google 0.88 6 33.3% $8.42
9 Grok 4 Fast (medium) xAI 0.79 6 33.3% $1.09
10 Kimi K2.5 (medium) Moonshotai 0.84 7 28.6% $1.00
11 Gemini 2.5 Flash (medium) (retired) Google 0.41 8 25.0% $1.23
12 Kimi K2 0905 (medium) (retired) Moonshotai 0.69 5 20.0% $1.15
13 Qwen3 Max Thinking (low) Qwen 0.17 5 20.0% $2.63
14 DeepSeek V3.2 DeepSeek 0.61 6 16.7% $1.10
15 MiniMax M2.1 (medium) Minimax 0.78 6 16.7% $0.91
16 Llama 4 Maverick Meta 0.46 7 14.3% $0.55
17 GLM 4.7 (medium) Z-Ai 0.99 8 12.5% $1.31
18 GPT-5 Mini (medium) (retired) OpenAI 1.14 6 0.0% $0.56
19 GPT-5 Nano (low) (retired) OpenAI 0.90 6 0.0% $0.08
20 Qwen3 235B Qwen 0.62 5 0.0% $0.17
21 MiMo V2 Flash (medium) Xiaomi 0.53 5 0.0% $0.31
22 Qwen3 Max Thinking (medium) Qwen 0.48 2 0.0% $1.66
23 Grok 4 (medium) (expensive) xAI 0.14 2 0.0% $6.01
24 GPT-5.2 (medium) OpenAI 0.28 1 0.0% $5.90
25 GPT-5.3 Codex (medium) OpenAI 0.34 1 0.0% $11.23
26 o3 (medium) OpenAI 0.31 1 0.0% $12.93
27 Grok 4.1 Fast (medium) xAI 1.33 1 0.0% $1.15