Field guide / Story / Receipts pack TRUE, BUT Lab Not Field
The patients were simulated The doctors were generalists working alone, the patients were simulated, and every author works for Microsoft.
“MAI-DxO is more than twice as accurate as physicians using textbooks and the internet”
Microsoft AI (MAI Health Team), 22 October 2026, announcing its Science paper; shared on r/artificial as AI doubling doctors' accuracy Recorded 23 October 2026. Our ruling means: literally true, materially misleading.
Read the story →
Receipts pack
The evidence file for this verdict 14 receipts: 4 support the claim, 2 contradict it, 8 add context. 3 figures on the record, 3 traced to a quoted receipt.
The receipts Each source, the line we quote from it, its date and which way it cuts. Free to read and to cite.
1 Supports the claim microsoft.ai ↗ 22 Oct 2026
MAI-DxO is more than twice as accurate as physicians using textbooks and the internet Look up an archived copy ↗
2 Supports the claim microsoft.ai ↗ 22 Oct 2026
Physicians achieved 22% without external reference resources and 36% with them, making MAI-DxO about 3.7 and 2.3 times more accurate, respectively. Look up an archived copy ↗
3 Context microsoft.ai ↗ 22 Oct 2026
Benchmarks matter, but the true test is performance in real clinical environments. Look up an archived copy ↗
4 Context microsoft.ai ↗ 22 Oct 2026
In a prospective study, patients will interact with the system directly, with performance measured against physicians’ independent assessments. Look up an archived copy ↗
5 Context microsoft.ai ↗ 22 Oct 2026
Through a new partnership with Beth Israel Deaconess Medical Center in Boston, we will evaluate clinical reasoning capabilities across different hospital settings. Look up an archived copy ↗
6 Supports the claim api.crossref.org ↗ 22 Oct 2026
outperforming generalist physicians (36.1 and 46.8%, respectively) Look up an archived copy ↗
7 Context api.crossref.org ↗ 22 Oct 2026
Although these findings were obtained in a controlled benchmark setting Look up an archived copy ↗
8 Contradicts the claim unite.ai ↗ 22 Oct 2026
The authors state that the comparisons do not show superiority over specialists, multidisciplinary teams, or real-world clinical practice Look up an archived copy ↗
9 Contradicts the claim unite.ai ↗ 22 Oct 2026
A further stated limitation is the comparison against individual physicians rather than multispecialty collaboration Look up an archived copy ↗
10 Context unite.ai ↗ 22 Oct 2026
conducted on 56 cases held out from engineering work Look up an archived copy ↗
11 Context unite.ai ↗ 22 Oct 2026
averaging 22.3% accuracy closed-book at $3,049 per case and 36.1% open-book at $4,725 Look up an archived copy ↗
12 Context unite.ai ↗ 22 Oct 2026
achieved 83.2% accuracy at an average cost of $5,431 per case Look up an archived copy ↗
13 Supports the claim unite.ai ↗ 22 Oct 2026
Cost-constrained configurations reached 80.9% accuracy at $2,241 and 79.6% at $1,303 Look up an archived copy ↗
14 Context unite.ai ↗ 22 Oct 2026
the authors state that all of them are Microsoft employees holding equity in the company Look up an archived copy ↗
Members' extras
What each receipt proves, and what would change our mind. What each receipt above proves, in our words The figures table, each number traced to the receipt that states it The trick behind the claim, explained, with the guide to spotting it What would change our verdict Our call on the record, with its due date The verdict, the opening and every receipt above stay free. Membership adds our analysis to the evidence file for every checked story.
First membership: 30 days free, then A$89 a year. One introductory trial per customer. Card required; renews annually until cancelled. Cancel before the trial ends to avoid the first charge.
Retry access check Members' extras need JavaScript. The receipts above work without it.