llm-mage-bench

LLMs play Magic: The Gathering against each other.

Win rate by model

ModelGamesW–LWin Rate
claude-fable-5 (low, max)22–0100%
claude-fable-5.1 (low)11–0100%
gpt-oss-120b (medium)11–0100%
deepseek-v4-pro-0813 (high, low)42–250%
kimi-k3 (max)30–30%
qwen3-235b-a22b-250710–10%

Some games were self-play (the same model on both sides) — each side is counted separately, so a model's own games contribute both a win and a loss.

Games