AIMA Research ✦ AIO 2026 cohort ✦ Project call

Three questions about the mind & the reading room.

Decode what the brain sees. Build AI that adapts to the radiologist, not the other way round. Teach the next generation where to look. Each project is a small research group with mentors at US universities.

3projects
12students
4per project
6months
I

Project I · Neuro-AI

Brain decoding: from fMRI & EEG to images and video

DDuke UniversityNNorthwestern University
 4 students · 6 months

In three years, brain decoding has gone from blurry shapes to photo-like images and smooth video. It has also learned that a strong diffusion prior can paint a convincing picture that the brain never saw. Our group will build on the best recent methods and ask how much of each reconstruction truly came from the brain.

Seeing, recording, decoding

Photograph shown to the viewer

1 What they see

a real photograph

2 The viewer

3 Recorded signal

4 Decoder

brain encoder → shared latent

5 Reconstruction

Try another photo

Photos: CC0, Wikimedia Commons. Steps 3–5 are illustrations of how decoders work, not output from a real recording; the reconstructions are softened versions of the photo made for this page.

Three years of the field, on one map

Thirty-one papers from 2023 to 2026, most at CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI and Nature-family journals. Filter by signal and output; hover or tap a paper for its one-line summary and link.

Signal Output

Eight open research gaps

Each gap is backed by the papers above and sized for four students and one to four GPUs. The group picks one or two with its mentors in month one.

01

Cross-subject decoding with little or no data

+

Shared-subject models cut new-subject data from 40 hours to about one3–6, and zero-shot decoding is emerging7. But zero-shot still trails fine-tuning, and almost all results come from the same 7–8 NSD subjects24.

DirectionA leave-one-subject-out benchmark of alignment methods (linear, transfer matrix, LoRA, adversarial) at 0, 15 and 60 minutes of new-subject data, plus a new hyperalignment-adapter baseline.

02

Faithfulness: is it the brain, or the prior?

+

A 30–50-dimensional bottleneck recovers most reconstruction quality9, and text-guided NSD models behave like category classifiers plus diffusion “hallucination”8. Common metrics reward plausible pictures, not faithful ones.

DirectionA faithfulness audit suite (bottleneck, shuffled-signal and noise controls, out-of-distribution test sets, category-leakage checks) used to re-score 4–5 open-source decoders. Mostly inference, so it needs little compute.

03

The EEG fidelity gap

+

EEG is cheap and portable, but reconstructions are semantically right and low-level wrong11,12. MEG decodes high-level features well over time13. Older EEG datasets carry a block-design confound18.

DirectionEEG-to-image on THINGS-EEG225 with a pretrained EEG foundation encoder23 and a separate low-level branch, reporting low- and high-level metrics separately. Trains on a single RTX 4090.

04

Low-level detail versus meaning

+

Most strong decoders split the problem into a low-level layout path and a semantic path2,16, but the trade-off between them is tuned by hand.

DirectionA controlled study of the low-level/semantic Pareto front per brain region (early visual cortex versus higher areas) on NSD, with region-specific adapters.

05

Temporal consistency in video decoding

+

fMRI is slow and the standard video set has only three subjects27. Motion can be invented by the video generator; permutation tests are needed to show it was decoded10,15–17.

DirectionAn explicit motion-decoding head with motion-shuffled baselines and temporal metrics on CC2017. Needs an A100 for video diffusion.

06

Real-time, portable decoding

+

MEG points toward real-time decoding13, and lightweight models now run on consumer-grade EEG14,28.

DirectionA latency- and parameter-efficient EEG decoder, measuring accuracy against number of channels and time window.

07

Generalizing beyond one dataset

+

NSD’s limited semantic diversity inflates results8. Few papers test on a second dataset.

DirectionTrain on NSD, test on THINGS-fMRI26 and other held-out sets, and report the drop on novel categories.

08

Brain to language, responsibly

+

Brain signals can be decoded into captions and continuous language19–22, which raises privacy questions and lacks hallucination-aware evaluation.

DirectionAn fMRI-to-caption evaluation on NSD with object-hallucination metrics, comparing open models, with an ethics section.

Aim 1 · Months 1–2

Reproduce and audit

Reproduce two open decoders (for example MindEye2 and ATM) and run the faithfulness controls from gap 02 on them.

Aim 2 · Months 3–4

Close one gap

Propose a method for the chosen gap: few-data cross-subject decoding, or low-level fidelity for EEG.

Aim 3 · Months 5–6

Evaluate honestly, then publish

Test on a second dataset, release code, and submit to a NeurIPS/ICLR workshop or a MICCAI-track venue.

Data

  • NSD, 7T fMRI, 8 subjects24
  • THINGS-EEG2 and THINGS-MEG / fMRI25,26
  • CC2017 video fMRI27
  • Alljoined consumer-grade EEG28

You will learn

  • fMRI and EEG preprocessing
  • Contrastive alignment and diffusion priors
  • Cross-subject adaptation (LoRA, alignment)
  • Evaluating generative models honestly

Good fit if you

  • Like neuroscience as much as generative models
  • Are comfortable with PyTorch and GPUs
  • Enjoy asking “is this result real?”
1
Data & signals

Preprocessing pipelines for NSD, THINGS and EEG; subject splits.

2
Baselines

Reproduces open decoders and keeps results reproducible.

3
Method

Designs the alignment, encoder or adapter for the chosen gap.

4
Evaluation

Owns metrics, faithfulness controls and figures.

II

Project II · Human-centered clinical AI

A self-adapting, radiologist-centered AI workflow for CT & MRI screening

YYale UniversityNNorthwestern University
 4 students · 6 months

We use AI agents to automate high-skill work on our own devices every day, yet the radiologist’s workflow has barely changed. We want to build a trustworthy agentic system that works with the radiologist in the loop: it triages, drafts and measures, learns from every correction, and knows when to step back.

The machine and the radiologist, working together

Chest CT of a solitary fibrous tumour of the pleura: Sean Novak, Wikimedia Commons, CC BY-SA 4.0. The outline, labels and report lines are illustrative.

Why today’s AI does not close the gap

Across 140 radiologists and 15 chest X-ray tasks, the effect of AI assistance varied widely from one reader to the next. Experience, subspecialty and prior AI use did not predict who would benefit, and wrong AI predictions made readers worse29.

  • Radiologists underweight AI advice and treat it as independent of their own read. Routing each case to either the human or the AI can do better than giving everyone the same assistance30.
  • Incorrect AI suggestions pulled mammography readers at every experience level toward the wrong answer31.
  • Explanations raised physician trust whether the AI was right or wrong32.
140

radiologists: the effect of the same AI assistance differed widely from reader to reader, and could not be predicted from experience.

Yu et al., Nature Medicine 2024 ↗

What makes this possible now

Deferral models learn when to hand a case to the clinician33. Clinicians and vision-language models already co-write reports34. LLM agents can orchestrate imaging tools without retraining35. What is missing is a system that adapts to each reader over time and is evaluated on whether readers actually do better.

Aim 1

An agentic first read

An agent that orchestrates open segmentation and detection tools on public CT/MRI to triage cases, measure findings and draft structured reports, with calibrated uncertainty.

Aim 2

Learning from every correction

Turn accept, edit and reject actions into feedback: per-reader calibration, deferral (“this one is yours”), and online updates that avoid learning a reader’s mistakes.

Aim 3

Measure trust, not just accuracy

Simulated readers first, then a small pilot with mentor radiologists: accuracy, reading time, over-reliance when the AI is wrong, and how that changes across sessions.

Data & tools

  • Public CT/MRI screening and segmentation datasets
  • Open segmentation and foundation models as agent tools
  • An LLM or VLM planner, run locally where possible

You will learn

  • Agentic AI and tool use
  • Uncertainty, calibration and learning to defer
  • Human-AI study design and clinical evaluation

Good fit if you

  • Want to build systems people actually use
  • Like software engineering as much as modelling
  • Care about what clinicians need
1
Agent & tools

Planner, tool calling and the first-read pipeline.

2
Vision models

Segmentation, detection, measurement and uncertainty.

3
Adaptation

Feedback learning, per-reader calibration and deferral.

4
Interface & study

Reading interface, simulated readers and the pilot study.

III

Project III · AI for medical education

AI-guided eye-gaze training for medical students & junior radiologists

NNorthwestern UniversityUHUniversity of Houston
 4 students · 6 months

AI now matches or beats less-experienced readers on several imaging tasks. Instead of only giving learners the answer, we want AI that teaches them how to find it: software that learns from where expert radiologists look, then guides a student’s gaze toward the regions and the search pattern an expert would use.

Learning where to look

    Chest radiograph of the same pleural tumour: Sean Novak, Wikimedia Commons, CC BY-SA 4.0. Scanpaths are illustrative: numbered circles are fixations (larger means longer), the glow is the gaze heatmap.

    The evidence

    • Deep-learning systems outperformed non-radiologist physicians and radiologists on chest radiographs, and improved every reader as a second opinion36,37.
    • A stand-alone mammography AI was non-inferior to the average of 101 radiologists38.
    • LLM help raised residents’ brain-MRI diagnostic accuracy far more than neuroradiologists’39, and wrong AI suggestions misled inexperienced readers the most31.

    The gap we target

    Gaze already helps train better models42–45, and public chest X-ray gaze datasets exist40,41. Yet a systematic review found little evidence that teaching novices to “search like an expert” improves diagnosis46. Whether AI-guided gaze training works is an open question, and we will test it.

    Aim 1

    Model the expert

    Train on expert-radiologist gaze only to predict, for a new image, the heatmap and the ordered scanpath an expert would follow.

    Aim 2

    Guide the learner

    Software that tracks a learner’s gaze (webcam or low-cost tracker), compares it with the expert model, and suggests the next region to check and what it has missed.

    Aim 3

    Does it teach?

    A pilot with medical students: guided versus unguided practice, measuring detection, coverage and whether the skill stays once guidance is turned off.

    Data

    • REFLACX: 3,032 cases with gaze and dictation41
    • EGD-CXR: 1,083 cases with gaze and reports40
    • Both build on MIMIC-CXR: PhysioNet credentialed access required

    You will learn

    • Eye-tracking data and saliency / scanpath models
    • Vision transformers for medical images
    • Designing an education study

    Good fit if you

    • Are a medical student or have a clinical interest
    • Like building interactive tools
    • Want to study how people learn
    1
    Gaze data

    REFLACX / EGD-CXR processing, fixations and scanpaths.

    2
    Expert model

    Heatmap and scanpath prediction from expert gaze.

    3
    Guidance app

    Real-time gaze capture and the guidance interface.

    4
    Education study

    Study design, metrics and analysis with mentors.

    ✦

    Six months

    From first paper to submission.

    All three groups share one rhythm, with weekly group meetings and a monthly review with mentors.

    Month 1
    Month 2
    Month 3
    Month 4
    Month 5
    Month 6
    I · Brain decodingDuke · Northwestern
    Reading & dataReproduce + auditMethod for the chosen gapCross-dataset testsWrite & submit
    II · Radiologist AIYale · Northwestern
    Workflow studyAgent + toolsAdaptation & deferralReader pilotWrite & submit
    III · Gaze guidanceNorthwestern · Houston
    Access & gaze dataExpert gaze modelGuidance appLearner pilotWrite & submit
    Onboarding Baselines Method Experiments & studies Writing
    M1
    Onboard

    Read 10–15 key papers, set up data access and compute, write a one-page proposal.

    M2
    Reproduce

    Match a published baseline. Share a reproducibility report.

    M3
    Propose

    First version of the method, defended in a mentor review.

    M4
    Iterate

    Ablations, failure analysis, fix what the review found.

    M5
    Validate

    External data or pilot study; freeze results.

    M6
    Submit

    Paper, code release and a talk for the AIMA community.

    Twelve seats · four per project

    Tell us which question
    you want to answer.

    Write to us with the project number, a short note on your background, and what you want to learn. Selection details for the AIO 2026 cohort will be announced by AIMA.

    Email AIMA Research AIMA 2026

    References

    1. Takagi & Nishimoto. High-resolution image reconstruction with latent diffusion models from human brain activity. CVPR 2023. link
    2. Scotti et al. Reconstructing the Mind’s Eye: fMRI-to-image with contrastive learning and diffusion priors. NeurIPS 2023. arXiv
    3. Scotti, Tripathy et al. MindEye2: Shared-subject models enable fMRI-to-image with 1 hour of data. ICML 2024. PMLR
    4. Wang et al. MindBridge: A cross-subject brain decoding framework. CVPR 2024. arXiv
    5. Gong et al. MindTuner: Cross-subject visual decoding with visual fingerprint and semantic correction. AAAI 2025. link
    6. Dai et al. MindAligner: Explicit brain functional alignment for cross-subject visual decoding from limited fMRI data. ICML 2025. PMLR
    7. Wang et al. ZEBRA: Towards zero-shot cross-subject generalization for universal brain visual decoding. NeurIPS 2025. OpenReview
    8. Shirakawa et al. Spurious reconstruction from brain activity. Neural Networks 2025. DOI
    9. Mayo et al. BrainBits: How much of the brain are generative reconstruction methods using? NeurIPS 2024. arXiv
    10. Lu et al. Animate your thoughts: Decoupled reconstruction of dynamic natural vision from slow brain activity (Mind-Animator). ICLR 2025. arXiv
    11. Song et al. Decoding natural images from EEG for object recognition (NICE). ICLR 2024. arXiv
    12. Li et al. Visual decoding and reconstruction via EEG embeddings with guided diffusion (ATM). NeurIPS 2024. arXiv
    13. Benchetrit, Banville & King. Brain decoding: toward real-time reconstruction of visual perception. ICLR 2024. arXiv
    14. Kneeland et al. ENIGMA: A unified lightweight EEG-to-image model for multi-subject visual decoding. NeurIPS 2025 Workshop. link
    15. Chen, Qing & Zhou. Cinematic Mindscapes: High-quality video reconstruction from brain activity (MinD-Video). NeurIPS 2023. arXiv
    16. Gong et al. NeuroClips: Towards high-fidelity and smooth fMRI-to-video reconstruction. NeurIPS 2024. arXiv
    17. Wang et al. NEURONS: Emulating the human visual cortex improves fidelity and interpretability in fMRI-to-video reconstruction. ICCV 2025. CVF
    18. Li et al. The perils and pitfalls of block design for EEG classification experiments. IEEE TPAMI 2021. DOI
    19. Xia et al. UMBRAE: Unified multimodal brain decoding. ECCV 2024. arXiv
    20. Qiu et al. MindLLM: A subject-agnostic and versatile model for fMRI-to-text decoding. ICML 2025. PMLR
    21. Tang et al. Semantic reconstruction of continuous language from non-invasive brain recordings. Nature Neuroscience 2023. DOI
    22. Horikawa. Mind captioning: Evolving descriptive text of mental content from human brain activity. Science Advances 2025. DOI
    23. Jiang et al. Large brain model for learning generic representations with tremendous EEG data in BCI (LaBraM). ICLR 2024. arXiv
    24. Allen et al. A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence (NSD). Nature Neuroscience 2022. DOI
    25. Gifford et al. A large and rich EEG dataset for modeling human visual object recognition (THINGS-EEG2). NeuroImage 2022. DOI
    26. Hebart et al. THINGS-data: fMRI, MEG and behavioral data on object representations. eLife 2023. DOI
    27. Wen et al. Neural encoding and decoding with deep learning for dynamic natural vision (CC2017). Cerebral Cortex 2018. DOI
    28. Alljoined: EEG datasets for natural-image decoding, including consumer-grade Alljoined-1.6M. arXiv · arXiv
    29. Yu, Moehring, Banerjee, Salz, Agarwal & Rajpurkar. Heterogeneity and predictors of the effects of AI assistance on radiologists. Nature Medicine 2024. DOI
    30. Agarwal et al. Combining human expertise with artificial intelligence: Experimental evidence from radiology. NBER Working Paper 31422, 2023. link
    31. Dratsch et al. Automation bias in mammography: The impact of artificial intelligence BI-RADS suggestions on reader performance. Radiology 2023. DOI
    32. Prinster et al. Care to explain? AI explanation types differentially impact chest radiograph diagnostic performance and physician trust in AI. Radiology 2024. DOI
    33. Dvijotham et al. Enhancing the reliability and accuracy of AI-enabled diagnosis via complementarity-driven deferral to clinicians (CoDoC). Nature Medicine 2023. DOI
    34. Tanno et al. Collaboration between clinicians and vision–language models in radiology report generation. Nature Medicine 2025. DOI
    35. Fallahpour et al. MedRAX: Medical reasoning agent for chest X-ray. ICML 2025. arXiv
    36. Hwang et al. Development and validation of a deep learning–based automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Network Open 2019. link
    37. Nam et al. Development and validation of deep learning–based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 2019. DOI
    38. Rodriguez-Ruiz et al. Stand-alone artificial intelligence for breast cancer detection in mammography: Comparison with 101 radiologists. JNCI 2019. DOI
    39. Performing best when needed least: Reader experience shapes accuracy gains in LLM-assisted brain MRI differential diagnosis. Radiology 2026. DOI
    40. Karargyris et al. Creation and validation of a chest X-ray dataset with eye-tracking and report dictation for AI development (EGD-CXR). Scientific Data 2021. DOI
    41. Bigolin Lanfredi et al. REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rays. Scientific Data 2022. DOI
    42. Bhattacharya et al. GazeRadar: A gaze and radiomics-guided disease localization framework. MICCAI 2022. link
    43. Bhattacharya et al. RadioTransformer: A cascaded global-focal transformer for visual attention-guided disease classification. ECCV 2022. arXiv
    44. Wang et al. Follow my eye: Using gaze to supervise computer-aided diagnosis. IEEE TMI 2022. arXiv
    45. Ma et al. Eye-gaze-guided vision transformer for rectifying shortcut learning. IEEE TMI 2023. DOI
    46. van der Gijp et al. How visual search relates to visual diagnostic performance: A narrative systematic review of eye-tracking research in radiology. Advances in Health Sciences Education 2017. DOI