Methodology
How we rank
Short version: independent tests decide the rankings, a public formula turns them into scores, official pricing pages tell us what each subscription includes, and nobody can pay to change any of it.
The idea in one sentence
Benchmarks test AI models, but you buy a subscription. So we check which models each subscription includes (on the official pricing page), and give every subscription the score of the best model it gives you.
The formula
- Each test becomes a score from 0 to 100. 100 is the best model from the companies we cover. For tests with a percentage (like "fixed 80% of the bugs"), a model's score is its share of the best result. For head-to-head votes (Elo ratings), it's how often it would win against the best model, scaled so the best = 100.
- Tests are combined per topic with the weights in the table below, averaged over the tests a model has results for. A model is ranked once it has results on at least 2 of a topic's tests, so brand-new models aren't left out while slower tests catch up. Every score shows how many tests it's based on ("based on 2 of 6 tests"): the more tests, the more solid the score.
- A subscription gets the score of its best model. If a plan only gives limited use of a model (as most free plans do), that model counts for 90% of its score.
- Best value (paid plans only): we subtract 4 points every time the monthly price doubles, starting from €1/$1.
- Is the free plan enough? "Yes" when the best free plan scores at least 92%of the best paid one, "mostly" from 80%, otherwise "no".
- The 30-second test averages the topics you pick, then adds 4 points if the tool works inside the apps you use, 4 points for a sourced privacy promise (such as "no logs") if privacy matters to you, and up to 3 points for ease of use if you're new to AI. Tools with a privacy warning are left out if privacy matters to you. If you say it must be a European company, the test only picks European options and shows the best non-European one next to it. When no European AI has test scores for what you picked, you get the best European all-rounder, and the test says so.
- Stay or switch? If you tell the test what you pay for now, it compares that plan with its pick in the same tests. Within 92% of the pick: stay, unless it costs more than your budget or has a privacy warning when privacy matters to you. Otherwise: switch.
Which tests count for which topic
Only the kinds of tools that make sense compete in a topic: a coding tool isn't "the best AI for writing".
Overall
- Arena: overall chat: 40%
- Artificial Analysis Intelligence Index: 27%
- GPQA Diamond: 13%
- SimpleQA Verified: 13%
- LiveBench: reasoning: 7%
Coding
- Arena: coding questions: 14%
- Arena: building websites: 14%
- SWE-bench Verified: 21%
- Artificial Analysis Coding Index: 21%
- LiveBench: coding: 14%
- LiveBench: agentic coding: 14%
Writing
- Arena: creative writing: 38%
- Arena: writing & language: 38%
- LiveBench: following instructions: 25%
Research & search
- Arena: search & research: 43%
- SimpleQA Verified: 29%
- DeepResearch Bench: 29%
Maths & hard problems
- Arena: maths: 20%
- GPQA Diamond: 20%
- FrontierMath (tiers 1-3): 20%
- LiveBench: maths: 20%
- LiveBench: reasoning: 20%
Studying
- Arena: homework help: 38%
- Arena: overall chat: 25%
- Arena: maths: 13%
- Arena: writing & language: 13%
- LiveBench: maths: 13%
Business & office
- Arena: business & finance: 22%
- Arena: working with documents: 22%
- Arena: following instructions: 22%
- LiveBench: data analysis: 22%
- LiveBench: following instructions: 11%
Images
- Arena: image generation: 40%
- Arena: image editing: 20%
- Artificial Analysis: image arena: 40%
Our own opinion: only with a visible reason
Benchmarks miss things like ease of use or customer service. So we can overrule a ranking, but only with a written reason that appears right next to it, marked "Editor's choice". "Our take" texts on tool cards are labeled as opinion and dated.
Not released yet? Never a recommendation
Some models appear in tests before you can buy them. They never become a recommendation. When one beats every subscription in a topic, we list it under "Coming soon", without a price or a buy link.
What counts as a source
Every benchmark source has to meet four requirements:
- Independent of the AI companies it measures.
- Open about its method, so anyone can check how scores are made.
- Actively maintained. Our update program warns us when a test hasn't added new models for six months, and we drop it.
- A licence that allows reuse, with credit where the licence asks for it.
For prices and plan contents we only use the company's own pricing page. Pages that block automated visits are checked by hand and marked until then.
How we keep it fresh
- Every week a program fetches all tests and pricing pages (an AI model helps read the pricing pages) and proposes the changes. A human reviews and approves every change before it goes live.
- Prices and plan contents are only accepted with a literal quote from the official page, which the program checks word for word.
- After 60 days without a new check, a fact gets a "May be outdated" warning.
- Every page has a "Report outdated info" button.
Every source we use
Independent tests
- Arena (formerly LMArena): Arena leaderboards (crowd-sourced blind comparisons) (CC BY 4.0)
- Artificial Analysis: Artificial Analysis (independent model benchmarks) (Free API; attribution required)
- Epoch AI: Benchmarking Hub (CC BY 4.0 (some external benchmarks keep their own license))
- LiveBench: LiveBench (contamination-free LLM benchmark) (Not stated for the data; scores cited with attribution (owner to confirm before launch))
Official pricing pages
- Anthropic: Claude plans & pricing
- Anysphere: Cursor models and pricing (docs)
- Anysphere: Cursor pricing
- DeepSeek: DeepSeek chat
- DeepSeek: Download DeepSeek
- DeepSeek: DeepSeek-V4-Pro release notes
- DeepSeek: DeepSeek privacy policy
- GitHub: GitHub Copilot plans
- Google: Gemini subscriptions (Netherlands, EUR)
- Google: Google AI plans (Google One)
- Infomaniak: Euria, the sovereign AI assistant
- Meta: Meta AI
- Meta: Meta AI: your personal AI assistant
- Meta: Introducing Muse Spark
- Microsoft: Compare Microsoft 365 plans for home
- Midjourney: Comparing Midjourney plans
- Mistral AI: About Mistral AI
- Mistral AI: Le Chat pricing
- Mistral AI: Vibe remote agents and Mistral Medium 3.5
- Ollama: Ollama model library
- Ollama: Ollama pricing
- OpenAI: What is ChatGPT Plus?
- OpenAI: About ChatGPT Pro tiers
- OpenAI: Introducing ChatGPT Go
- OpenAI: ChatGPT pricing
- Perplexity: Billing FAQ for Pro plan subscribers
- Perplexity: Which Perplexity subscription plan is right for you?
- Perplexity: What is Perplexity Pro?
- Perplexity: Perplexity pricing
- Perplexity: Perplexity Pro
- Proton: Lumo plans and pricing
- Proton: Lumo privacy and models
- xAI: Grok plans
- xAI: Grok plans
- xAI: xAI pricing
Leaderboard data: Arena (arena.ai), CC BY 4.0 · Benchmark data: Artificial Analysis (artificialanalysis.ai) · Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks, CC BY 4.0 · Benchmark data: LiveBench (livebench.ai)