Ryutaro Tanno

Research

See Google Scholar for the most up-to-date publications. * Equal contribution.

Publications

2026

  1. Conversational diagnostic artificial intelligence in ambulatory primary care: a prospective feasibility study

    Peter G Brodeur, Jacob M Koshy, Anil Palepu, …, Ryutaro Tanno, …, Adam Rodman

    The Lancet 2026

    AMIE took histories from 100 patients ahead of real urgent-care appointments, under clinician oversight.

  2. Towards Expert-level Medical AI for Real-time Video Consultations

    Mahvish Nagda*, Jihyeon Lee*, Matthew Thompson, …, Ryutaro Tanno, …, Anil Palepu

    arXiv 2026

  3. Towards conversational artificial intelligence for disease management

    Valentin Liévin*, Anil Palepu*, Wei-Hung Weng, …, Ryutaro Tanno, …, Mike Schaekermann

    Nature 2026

    Takes AMIE from diagnosis to management: reasoning across visits, response to therapy and safe prescribing.

  4. Accelerating scientific discovery with Co-Scientist

    Juraj Gottweis*, Wei-Hung Weng*, Alexander Daryin*, …, Ryutaro Tanno, …, Vivek Natarajan

    Nature 2026

    A multi-agent AI that generates, critiques and refines hypotheses; its drug-repurposing candidates for leukaemia held up in the lab.

  5. Advancing conversational diagnostic AI with multimodal reasoning

    Khaled Saab*, Chunjong Park*, Tim Strother*, …, Ryutaro Tanno*

    Nature Medicine 2026

    AMIE asks for, reads and reasons over images and documents mid-conversation, beating primary care physicians on 29 of 32 axes.

  6. Towards Conversational Medical AI with Eyes, Ears and a Voice

    Meet Shah*, Jason Gusdorf*, Anil Palepu*, …, Ryutaro Tanno*

    arXiv 2026 · Under review at Cell

    AI co-clinician: a real-time agent that sees, hears and speaks with patients over live video.

  7. CoRefine: Confidence-Guided Self-Refinement for Adaptive Test-Time Compute

    Chen Jin, Ryutaro Tanno, Tom Diethe, Philip Teare

    arXiv 2026

  8. A large language model for complex cardiology care

    Jack W. O’Sullivan*, Anil Palepu*, Khaled Saab, …, Ryutaro Tanno, …, Tao Tu

    Nature Medicine 2026

    Puts AMIE to work on 204 complex real-world cases from a subspecialist cardiology practice.

2025

  1. Complementary Human-AI Clinical Reasoning in Ophthalmology

    Mertcan Sevgi, Fares Antaki, Abdullah Zafar Khan, …, Ryutaro Tanno, …, Wei-Hung Weng

    arXiv 2025

  2. Exploring Large Language Models for Specialist-Level Oncology Care

    Anil Palepu, Vikram Dhillon, Polly Niravath, …, Ryutaro Tanno, …, Tao Tu

    NEJM AI 2025

    Probes AMIE, with no oncology-specific training, on 50 breast cancer cases from treatment-naive to refractory.

  3. Towards physician-centered oversight of conversational diagnostic AI

    Elahe Vedadi*, David Barrett, Natalie Harris, …, Ryutaro Tanno, …, David Stutz*

    arXiv 2025

    Guardrailed AMIE takes the history but leaves diagnosis and treatment to an overseeing physician.

  4. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

    Gemini Team

    arXiv 2025

    Gemini 2.5: frontier reasoning, multimodality, long context and agentic capabilities.

  5. Towards conversational diagnostic artificial intelligence

    Tao Tu*, Mike Schaekermann*, Anil Palepu*, …, Ryutaro Tanno, …, Vivek Natarajan

    Nature 2025

    In blinded text consultations, AMIE was more accurate than primary care physicians and rated better on 30 of 32 axes by specialists.

  6. Diffusion Instruction Tuning

    Chen Jin, Ryutaro Tanno, Amrutha Saseendran, Tom Diethe, Philip Teare

    ICML 2025

    Aligns a vision-language model’s attention with Stable Diffusion’s, boosting visual understanding with just 0.13M training examples.

  7. Collaboration between clinicians and vision–language models in radiology report generation

    Ryutaro Tanno*, David G. T. Barrett*, Andrew Sellergren, …, Ira Ktena

    Nature Medicine 2025

    Radiologists rated most AI-drafted chest X-ray reports as good as or better than clinicians’ own; we show clinicians and AI writing them together.

2024

  1. Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understanding

    Talfan Evans*, Shreya Pathak*, Hamza Merzic*, Jonathan Schwarz, Ryutaro Tanno, Olivier J. Hénaff*

    ECCV 2024

    Small, cheap proxy models choose what a large model should learn from, cutting total training compute.

  2. Advancing Multimodal Medical Capabilities of Gemini

    Lin Yang*, Shawn Xu*, Andrew Sellergren*, …, Ryutaro Tanno, …, Daniel Golden

    arXiv 2024

  3. An Image is Worth Multiple Words: Discovering Object Level Concepts using Multi-Concept Prompt Learning

    Chen Jin, Ryutaro Tanno, Amrutha Saseendran, Tom Diethe, Philip Teare

    ICML 2024

    Learns several new ‘words’ at once from a single image and sentence, one for each object in the scene.

  4. Capabilities of Gemini Models in Medicine

    Khaled Saab*, Tao Tu*, Wei-Hung Weng*, Ryutaro Tanno*, …, Vivek Natarajan

    arXiv 2024

    Gemini models specialised for medicine set new state-of-the-art results on 10 of 14 medical benchmarks.

  5. Towards Generalist Biomedical AI

    Tao Tu, Shekoofeh Azizi, Danny Driess, …, Ryutaro Tanno, …, Vivek Natarajan

    NEJM AI 2024

  6. Generative models improve fairness of medical classifiers under distribution shifts

    Ira Ktena*, Olivia Wiles*, Isabela Albuquerque, …, Ryutaro Tanno, …, Sven Gowal

    Nature Medicine 2024

    Generative models learn realistic augmentations from unlabelled data, making medical classifiers fairer under distribution shift.

2023

  1. Deep learning for the prediction of clinical outcomes in internet-delivered CBT for depression and anxiety

    Niranjani Prasad, Isabel Chien, Tim Regan, …, Ryutaro Tanno, …, Anja Thieme

    PLOS ONE 2023

  2. Low-field magnetic resonance image enhancement via stochastic image quality transfer

    Hongxiang Lin, Matteo Figini, Felice D’Arco, …, Ryutaro Tanno, …, Daniel C. Alexander

    Medical Image Analysis 2023

  3. Learning from multiple annotators for medical image segmentation

    Le Zhang*, Ryutaro Tanno*, Moucheng Xu, …, Daniel C. Alexander

    Pattern Recognition 2023

2022

  1. Repairing Neural Networks by Leaving the Right Past Behind

    Ryutaro Tanno, Melanie F. Pradier, Aditya Nori, Yingzhen Li

    NeurIPS 2022

    Finds the training examples behind a model’s failure and repairs it by making the model forget them.

  2. Uncertainty Quantification in Medical Image Synthesis

    Riccardo Barbano, Simon Arridge, Bangti Jin, Ryutaro Tanno

    Book chapter 2022

    A survey of uncertainty quantification in medical image synthesis, and why it matters for clinicians’ trust.

  3. Learning to Downsample for Segmentation of Ultra-High Resolution Images

    Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander

    ICLR 2022

    Learns where to sample an ultra-high-resolution image before segmenting it, keeping detail where it matters.

  4. Active Label Cleaning for Improved Dataset Quality under Resource Constraints

    Mélanie Bernhardt*, Daniel C. Castro*, Ryutaro Tanno*, …, Ozan Oktay

    Nature Communications 2022

    Decides which noisy labels to re-annotate first, to get the most out of a limited labelling budget.

2021

  1. A Principled Approach to Failure Analysis and Model Repairment: Demonstration in Medical Imaging

    Thomas Henn, Yasukazu Sakamoto, Clement Jacquet, Shunsuke Yoshizawa, …, Yingzhen Li, Ryutaro Tanno

    MICCAI 2021

    A principled way to find where a model fails and repair it, demonstrated in medical imaging.

2020

  1. Disentangling Human Error from the Ground Truth in Segmentation of Medical Images

    Le Zhang*, Ryutaro Tanno*, Moucheng Xu, Joseph Jacob, Olga Ciccarelli, Frederik Barkhof, Daniel C. Alexander

    NeurIPS 2020

    Separates each annotator’s errors from the true segmentation when experts disagree.

  2. Foveation for Segmentation of Ultra-High Resolution Images

    Chen Jin*, Ryutaro Tanno*, Moucheng Xu, Thomy Mertzanidou, Daniel C. Alexander

    MICCAI 2020

    Learns where to look in gigapixel images, trading field of view against resolution.

  3. Uncertainty Quantification in Deep Learning for Safer Neuroimage Enhancement

    Ryutaro Tanno, Daniel Worrall, Enrico Kaden, Aurobrata Ghosh, Francesco Grussu, Alberto Bizzi, Stamatios N. Sotiropoulos, Antonio Criminisi, Daniel C. Alexander

    NeuroImage 2020

    Measures the different sources of uncertainty in deep-learning image enhancement, so errors can be flagged without ground truth.

2019

  1. Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernels

    Felix J.S. Bragman*, Ryutaro Tanno*, Sebastien Ourselin, Daniel C. Alexander, M. Jorge Cardoso

    ICCV 2019 · Oral

    Learns which convolution kernels to share across tasks and which to specialise.

  2. Adaptive Neural Trees

    Ryutaro Tanno, Kai Arulkumaran, Daniel C. Alexander, Antonio Criminisi, Aditya Nori

    ICML 2019 · Oral

    Adaptive neural trees: neural networks that grow a decision-tree structure to fit the data.

  3. Learning From Noisy Labels By Regularized Estimation Of Annotator Confusion

    Ryutaro Tanno, Ardavan Saeedi, Swami Sankaranarayanan, Daniel C. Alexander, Nathan Silberman

    CVPR 2019

    Recovers the truth from noisy labels by estimating each annotator’s confusions.

2018

  1. Uncertainty in multitask learning: joint representations for probabilistic MR-only radiotherapy planning

    Felix J.S. Bragman, Ryutaro Tanno, Zach Eaton-Rosen, Wenqi Li, David J. Hawkes, Sebastien Ourselin, Jamie R. McClelland, Daniel C. Alexander, M. Jorge Cardoso

    MICCAI 2018 · Spotlight

    One probabilistic network synthesises CT from MRI and segments organs at risk, with uncertainty, for MR-only radiotherapy.

  2. AutoDVT: Joint Real-Time Classification for Vein Compressibility Analysis in Deep Vein Thrombosis Ultrasound Diagnostics

    Ryutaro Tanno, Antonios Makropoulos, Salim Arslan, Ozan Oktay, Sven Mischkewitz, Fouad Al-Noor, Jonas Oppenheimer, Ramin Mandegaran, Bernhard Kainz, Mattias P. Heinrich

    MICCAI 2018

    Real-time deep learning for diagnosing deep vein thrombosis from ultrasound video.

  3. Deeper Image Quality Transfer: Training Low-Memory Neural Networks for 3D Images

    Stefano B. Blumberg, Ryutaro Tanno, Iasonas Kokkinos, Daniel C. Alexander

    MICCAI 2018

    Memory-efficient backpropagation lets very deep networks train on large 3D medical images.

  4. Semi-Supervised Learning via Compact Latent Space Clustering

    Konstantinos Kamnitsas, Daniel C. Castro, Loic Le Folgoc, Ian Walker, Ryutaro Tanno, Daniel Rueckert, Ben Glocker, Antonio Criminisi, Aditya Nori

    ICML 2018 · Long oral

    Semi-supervised learning that clusters the latent space so classes separate cleanly.

2017

  1. Image Quality Transfer and Applications in Diffusion MRI

    Daniel C. Alexander, Darko Zikic, Aurobrata Ghosh, Ryutaro Tanno, …, Antonio Criminisi

    NeuroImage 2017

    Image quality transfer: machine learning that brings the detail of rare, high-quality scans to routine ones.

  2. Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution

    Ryutaro Tanno, Daniel E. Worrall, Aurobrata Ghosh, Enrico Kaden, Stamatios N. Sotiropoulos, Antonio Criminisi, Daniel C. Alexander

    MICCAI 2017 · Best Paper Award

    Neural networks that enhance the resolution of brain MRI and estimate how uncertain each result is.

2016

  1. Bayesian Image Quality Transfer

    Ryutaro Tanno, Aurobrata Ghosh, Francesco Grussu, Enrico Kaden, Antonio Criminisi, Daniel C. Alexander

    MICCAI 2016

    A Bayesian take on image quality transfer that says how confident it is in each enhanced voxel.

Patents

  1. Ryutaro Tanno, Aditya Nori, Melanie Fernandez Pradier, Yingzhen Li. Correcting a machine learning model. US 12,613,939 B2, 2026.

  2. Aditya Nori, Antonio Criminisi, Ryutaro Tanno. Neural trees. US20200005148A1, 2020. Granted as US 11,676,078 B2 (2023).

  3. Fouad Al Noor, Sven Mischkewitz, Antonis Makropoulos, Ryutaro Tanno, Bernhard Kainz, Ozan Otay. Blood vessel obstruction diagnosis method, apparatus & system. WO2018162888A1, 2018.