HealthBench Professional

HealthBench Professional Leaderboard

Last updated August 16, 2026 · 9 models evaluated

Claude Fable 5 leads the HealthBench Professional leaderboard at 0.660, ahead of GPT-5.6 Sol (0.605) and Claude Opus 5 (0.598). The benchmark, published by OpenAI in April 2026, scores models on 525 tasks physicians selected from real clinician conversations, graded against physician-written rubrics on a 0 to 1 scale. Physician-written responses score 0.437 on the same rubrics.

Leaderboard

525-task set, one response per task. Updated August 16, 2026.

physician baseline 0.437
0.660
0.605
0.598
0.578
0.577
0.558
0.557
0.384
0.350
Anthropic logo
OpenAI logo
Anthropic logo
Anthropic logo
OpenAI logo
Anthropic logo
OpenAI logo
OpenAI logo
Microsoft logo
Claude Fable 5
GPT-5.6 Sol
Claude Opus 5
Claude Sonnet 5
GPT-5.6 Terra
Claude Opus 4.8
GPT-5.6 Luna
GPT-5.5 Instant
MAI-Thinking-1

Full ranking

#modelscoresizecontextcost in / out per 1Mlicense
1Anthropic logoClaude Fable 5 Anthropic0.6601.0M$10.00 / $50.00proprietary
2OpenAI logoGPT-5.6 Sol OpenAI0.6051.1M$5.00 / $30.00proprietary
3Anthropic logoClaude Opus 5 Anthropic0.5981.0M$5.00 / $25.00proprietary
4Anthropic logoClaude Sonnet 5 Anthropic0.5781.0M$2.00 / $10.00proprietary
5OpenAI logoGPT-5.6 Terra OpenAI0.5771.1M$2.00 / $12.00proprietary
6Anthropic logoClaude Opus 4.8 Anthropic0.5581.0M$5.00 / $25.00proprietary
7OpenAI logoGPT-5.6 Luna OpenAI0.5571.1M$0.20 / $1.20proprietary
8OpenAI logoGPT-5.5 Instant OpenAI0.384400K$5.00 / $30.00proprietary
9Microsoft logoMAI-Thinking-1 Microsoft0.3501.0Tproprietary

Rubric credit on the 525-task set, graded with the benchmark's default grader (GPT-5.4, low reasoning effort), one response per task. List API prices per 1M tokens as of August 16, 2026. GPT-5.6 models charge higher rates above 272K input tokens. MAI-Thinking-1 is in public preview on Microsoft Foundry without final list pricing. Each model name links to its full result.

9
models evaluated
3
labs represented
525
physician-authored tasks
15,079
clinician conversations screened
190
contributing physicians
50
countries represented

What the benchmark measures

HealthBench Professional evaluates language models on the work clinicians actually bring to a model: care consults such as differential diagnosis and management questions, clinical writing and documentation, and medical research. The 525 tasks were selected by physicians from 15,079 real clinician conversations, difficult cases were deliberately overweighted, and roughly a third of the set is adversarial. 190 physicians across 50 countries and 26 specialties wrote and adjudicated the rubrics. The full construction is described on the benchmark page.

How to read the scores

Scores are earned rubric points divided by possible points, clipped to 0 to 1, with a length adjustment that keeps verbosity from buying credit. Absolute numbers run low by design: the field's best result is 0.660, and physician-written responses score 0.437 on the same rubrics. Scores depend on the grader model, so numbers graded under a different configuration are not directly comparable; every score on this site comes from the same run protocol, described on the methodology page.

Head to head

Score, price, and context differences for the pairings people actually weigh, with the full score-difference matrix on the compare page.

Data

The full results are published as JSON and CSV at stable URLs, licensed CC BY 4.0. Citation format and version history are on the data page.