Start with two full samples. Sign in for this edition’s free story. Sources and corrections stay open.
What the pen marks mean
rememberThe takeaway: what to remember
figureThe number that matters
evidenceThe evidence line
rulingThe ruling
claimThe claim that fails
Each mark is drawn once, as you reach it. Numbers are only circled when they come from the story’s own figures.
01 / RulesTrue, butFree sample
The Home Office's asylum AI failed 45 of 203 expert checks after rollout. Experts checked about 0.3% of the summaries.
UK Home Office, Evaluation of AI trials in the asylum decision-making process (gov.uk, 29 April 2025) ·
AI illustration
Open Rights Group published Home Office figures showing 45 of 203 sampled AI interview summaries failed the first-stage expert check after the tool was rolled out in April 2026.
The reality check
The pilot evaluation reported 9% inaccurate and 23 minutes saved per case. The field sample shows 22% failing, covers about 0.3% of summaries, and lets summaries that omit details pass.
Why care? Asylum decisions rest on what applicants said. The tool's field accuracy is known only from a 0.3% sample, it fails more than twice as often as in the pilot, and omissions are not counted as failures.
Take this with youAfter rollout, Home Office experts failed 45 of the 203 asylum AI summaries they checked, more than double the pilot's 9%, and they checked about 0.3% of them.
Open the evidence4 source pages +
The claim we checked
AI summaries of asylum interviews save Home Office decision-makers 23 minutes per case, with only a small proportion (9%) of summaries found inaccurate in the pilot.
These are quoted receipts, not a count of independent investigations. Several reports may rely on the same original source.
Gemini 4 Carbon is #1 on Artificial Analysis, and the tester agrees. It leads 4 of the 9 tests, and most people cannot use it yet.
Google, Gemini 4 Carbon launch post (28 October 2026), echoed on Hacker News ·
AI illustration
Google launched Gemini 4 Carbon and said it ranks #1 on Artificial Analysis Intelligence Index v5 at 59.
The reality check
Artificial Analysis confirms the #1, with the top score in 4 of 9 evaluations, and says Carbon does not lead coding or knowledge work and is not yet publicly available. Google's own post puts it #4 on WebDev Arena.
Why care? A composite #1 is not a #1 on your task, and a model you cannot call does not change your stack this week. Check the sub-score for your work and budget on the standard $4 / $20 price.
Take this with youCarbon tops the Artificial Analysis index overall but leads only 4 of its 9 tests, and is not yet publicly available.
Open the evidence4 source pages +
The claim we checked
Google's Gemini 4 Carbon ranks #1 on Artificial Analysis Intelligence Index v5, making it the best AI model available.
These are quoted receipts, not a count of independent investigations. Several reports may rely on the same original source.
Given only a compiled binary and its documentation, agents must architect and implement a complete codebase that reproduces the original program's behavior.
A curated directory. Check each entry’s date and sources.
Make a little room for clarity.
Get the next checked edition in your inbox.
At sign-up: 30 days free. Payment card required. One introductory trial per customer.
Your trial ends 30 days after you start. Unless you cancel before then in Account → Manage subscription, we charge A$89 for the first year. It renews automatically at A$89/yr until cancelled.
You can ask for a full refund within 14 days after any annual payment, renewals included, with no reason needed, by emailing [email protected]. This voluntary refund does not limit your rights under the Australian Consumer Law.
