Friday, Jul 24, 2026 The claims desk. Receipts included. POWERED BY LENZ ↗
IsThis

HEALTH

The Claim

An artificial intelligence model can detect early-stage breast cancer with approximately 94% accuracy, surpassing the average performance of radiologists.

Verified by Lenz ·

The Short Version

The claim conflates AUC/AUROC scores (~0.93) with "accuracy," which are different metrics. The best available meta-analytic evidence reports pooled AI sensitivity of 0.85 and AUC of 0.89 — not 94%. Critically, 2025 RSNA studies show AI misses approximately 14% of cancers, with false negatives concentrated in smaller, early-stage tumors in dense breasts — the very cases the claim highlights. While AI can match or modestly exceed average radiologists in some contexts, the specific "~94% accuracy for early-stage detection" framing significantly overstates the evidence.

Caveats

  • The '~94% accuracy' figure conflates AUC/AUROC (a discriminative metric) with overall accuracy — these are not interchangeable, and the best meta-analytic evidence reports pooled AUC of 0.89 and sensitivity of 0.85.
  • AI's documented false negatives disproportionately affect smaller, lower-grade, early-stage tumors in dense breast tissue (RSNA 2025), directly undermining the 'early-stage detection' framing of the claim.
  • The comparison to 'average radiologist performance' is highly context-dependent — radiologist sensitivity ranges from 63% to 97% across studies, and the most cited AI-vs-radiologist comparison (AUROC 0.93 vs 0.90) was not statistically significant (P=.21).

The Receipts

  1. Current state of mammography-based artificial intelligence for future ...

    PubMed

  2. Study Reveals Key Traits of Breast Cancers Often Missed by AI Tools

    RSNA

  3. How Well Does AI Detect Invasive Breast Cancers? - RSNA

    RSNA

  4. Study Finds Radiologist Characteristics Predict Performance in Screening Mammography

    RSNA Journals

  5. Artificial intelligence versus radiologists in detecting early-stage breast cancer from mammograms: a meta-analysis of paradigm shifts - PMC

    PMC

  6. Impact of AI on Breast Cancer Detection Rates in Mammography by Radiologists of Varying Experience Levels in Singapore: Preliminary Comparative Study - PMC

    PMC

  7. Exploring AI Approaches for Breast Cancer Detection and Diagnosis: A Review Article - PMC

    PMC

  8. Artificial Intelligence in Breast Cancer Diagnosis and Personalized Medicine - PMC

    PMC

  9. Radiologists' ability to accurately estimate and compare their own interpretative mammography performance to their peers - PMC

    PMC

  10. Association between Radiologists' Experience and Accuracy in Interpreting Screening Mammograms - PMC

    PMC

+ 9 more sources — see the full list on Lenz

Filed Under

Artificial Intelligence ModelBreast CancerRadiologist

More Fact Checks