AIMA 2026 projects ✦ Project II ✦ Human-centered clinical AI
A self-adapting, radiologist-centered AI workflow for CT & MRI screening
We use AI agents to automate high-skill work on our own devices every day, yet the radiologist’s workflow has barely changed. We want to build a trustworthy agentic system that works with the radiologist in the loop: it triages, drafts and measures, learns from every correction, and knows when to step back.
In partnership with
The machine and the radiologist, working together
Chest CT of a solitary fibrous tumour of the pleura: Sean Novak, Wikimedia Commons, CC BY-SA 4.0. The outline, labels and report lines are illustrative.
Why today’s AI does not close the gap
Across 140 radiologists and 15 chest X-ray tasks, the effect of AI assistance varied widely from one reader to the next. Experience, subspecialty and prior AI use did not predict who would benefit, and wrong AI predictions made readers worse1.
- Radiologists underweight AI advice and treat it as independent of their own read. Routing each case to either the human or the AI can do better than giving everyone the same assistance2.
- Incorrect AI suggestions pulled mammography readers at every experience level toward the wrong answer, the least experienced most of all3.
- Explanations raised physician trust whether the AI was right or wrong4.
radiologists: the effect of the same AI assistance differed widely from reader to reader, and could not be predicted from experience.
Yu et al., Nature Medicine 2024 ↗What makes this possible now
Deferral models learn when to hand a case to the clinician5. Clinicians and vision-language models already co-write reports6. LLM agents can orchestrate imaging tools without retraining7. What is missing is a system that adapts to each reader over time and is evaluated on whether readers actually do better.
An agentic first read
An agent that orchestrates open segmentation and detection tools on public CT/MRI to triage cases, measure findings and draft structured reports, with calibrated uncertainty.
Learning from every correction
Turn accept, edit and reject actions into feedback: per-reader calibration, deferral (“this one is yours”), and online updates that avoid learning a reader’s mistakes.
Measure trust, not just accuracy
Simulated readers first, then a small pilot with mentor radiologists: accuracy, reading time, over-reliance when the AI is wrong, and how that changes across sessions.
Data & tools
- Public CT/MRI screening and segmentation datasets
- Open segmentation and foundation models as agent tools
- An LLM or VLM planner, run locally where possible
You will learn
- Agentic AI and tool use
- Uncertainty, calibration and learning to defer
- Human-AI study design and clinical evaluation
Good fit if you
- Want to build systems people actually use
- Like software engineering as much as modelling
- Care about what clinicians need
Agent & tools
Planner, tool calling and the first-read pipeline.
Vision models
Segmentation, detection, measurement and uncertainty.
Adaptation
Feedback learning, per-reader calibration and deferral.
Interface & study
Reading interface, simulated readers and the pilot study.
The plan · 6 months
From first paper to submission.
Six months, from first paper to submission, with weekly group meetings and a monthly review with mentors.
Onboard
Read 10–15 key papers, set up data access and compute, write a one-page proposal.
Reproduce
Match a published baseline. Share a reproducibility report.
Propose
First version of the method, defended in a mentor review.
Iterate
Ablations, failure analysis, fix what the review found.
Validate
External data or pilot study; freeze results.
Submit
Paper, code release and a talk for the AIMA community.
Project II · Human-centered clinical AI
Want to work on
this question?
Apply through the form by November 7, 2026, choosing Project II, with an academic CV and a statement of purpose of up to 300 words. Interviews run November 9 to 13, and groups start around November 18. Mentors from Yale University · Northwestern University.
References
- Yu, Moehring, Banerjee, Salz, Agarwal & Rajpurkar. Heterogeneity and predictors of the effects of AI assistance on radiologists. Nature Medicine 2024. DOI
- Agarwal et al. Combining human expertise with artificial intelligence: Experimental evidence from radiology. NBER Working Paper 31422, 2023. link
- Dratsch et al. Automation bias in mammography: The impact of artificial intelligence BI-RADS suggestions on reader performance. Radiology 2023. DOI
- Prinster et al. Care to explain? AI explanation types differentially impact chest radiograph diagnostic performance and physician trust in AI. Radiology 2024. DOI
- Dvijotham et al. Enhancing the reliability and accuracy of AI-enabled diagnosis via complementarity-driven deferral to clinicians (CoDoC). Nature Medicine 2023. DOI
- Tanno et al. Collaboration between clinicians and vision–language models in radiology report generation. Nature Medicine 2025. DOI
- Fallahpour et al. MedRAX: Medical reasoning agent for chest X-ray. ICML 2025. arXiv