CAIHL read · Jun 6, 2026
Geographic Bias and Diversity in AI Evaluation
Framework
What CAIHL does
Critical AI Health Literacy (CAIHL) is an analytical lens — Hugo Campos and Liz Salmi's 2025 National Academy of Medicine commentary, "Critical AI Health Literacy as Liberation Technology." It applies Paulo Freire's theory of critical literacy to health AI.
The central question CAIHL asks is whose interests does this AI actually serve? Four dimensions answer it: who is the primary user, where is it hosted, whose interests does it advance, and does it expand or constrain patient agency.
This deep-read separates the four dimensions on a single item from the day's scan, so you can see the specific structural shape of the AI in question — not just the bucket it landed in.
The four dimensions
How this item reads through CAIHL
Primary user
mixed
Both patients and clinicians interact directly with this AI.
Hosting
institutional
Hosted inside a health system, insurer, or large employer. Access controlled by the institution.
Interests
mixed
Multiple stakeholder interests in tension; the alignment is not stable.
Agency
constraining
Channels patients toward predetermined pathways or substitutes for patient capabilities.
Editor's CAIHL read
One-sentence synthesis
Evaluation-layer geographic bias; constraining agency for populations the benchmark does not see.
In the scan
How this item appeared in the daily scan
Editor's note: If the evaluation benchmark under-represents a population, the deployed system underperforms on that population — and the deployment metric will not see it. The patient in São Paulo or Lagos is the silent failure mode.
Summary: arXiv preprint: Audit of geographic bias in AI evaluation suites — benchmarks under-represent populations outside the Global North in ways that compound through downstream deployment.
methodology
Limitations
CAIHL is a lens, not a verdict. The four dimensions are conditions of use — reassess them when a tool's business model, deployment context, or patient behavior changes. See the NAM commentary for the full framework.