Using Diffusion Models for Tomographic Imaging

We are looking for students who have a strong background in computational imaging or a related field, while a basic understanding of probability, inference, and generative AI is important. Familiarity in Python and deep learning frameworks such as PyTorch is also required.

Project description

Diffusion models have recently revolutionized image generation and are increasingly used as learned priors to recover missing information in inverse imaging problems. Computed Tomography (CT) reconstruction is one such problem, where information loss can occur due to limited measurements, motion, or dose constraints. Applying diffusion models to CT is a promising but non-trivial task, as these models usually require large training datasets, the pretrained models have mostly been trained on natural images or videos, and combining image generation with the physics of CT is not always straightforward. These open several interesting research directions.
In this project, you will choose from a few possible research directions: leveraging off-the-shelf video diffusion models for dynamic CT, noise schedule design for balancing learned prior and physics, or developing diffusion bridges that mimic the progressive CT acquisition process. Other related ideas on these topics are also welcome to discuss. Depending on the chosen direction, the work will either show how existing diffusion models can be leveraged for tomography without large CT datasets, or propose alternative strategies to achieve high-quality reconstructions under limited data conditions.

Supervision & focus areas

Supervisor : Tristan van Leeuwen (CWI),

Keywords : tomographic imaging, inverse problems, diffusion models

EU Horizon 2020 grant award for realtime CT imaging project ‘xCting’

Project ‘xCTing’ from CWI’s Computational Imaging (CI) group and partners, has been awarded a grant from the EU Horizon 2020 Marie Curie Innovative Training Networks programme.

EU Horizon 2020 grant award for realtime CT imaging project ‘xCting’

CWI develops New Techniques for Real-time Tomographic Reconstruction

Jan-Willem Buurlage of CWI's Computational Imaging group introduces various techniques that significantly reduce the time it takes to run conventional tomographic reconstruction algorithms without affecting image quality. He will defend his thesis …

CWI develops New Techniques for Real-time Tomographic Reconstruction

Innovation fund North Holland supports CWI startup Photosynthetic B.V.

Photosynthetic B.V., a new CWI startup, has received a convertible loan of €300.000 from Innovation Fund North Holland. Photosynthetic is a deep-tech startup working on a hardware solution for the microfabrication industry.

Innovation fund North Holland supports CWI startup Photosynthetic B.V.

Can CT Scans Be Used to Quickly and Accurately Diagnose COVID-19?

CWI’s Computational Imaging group joins research collaboration focusing on improving the accuracy of CT scan diagnosis

Can CT Scans Be Used to Quickly and Accurately Diagnose COVID-19?

CWI starts research project within NWO programme Smart Solutions for Horti- and Agriculture

A consortium led by Joost Batenburg of CWI’s Computational Imaging group has been awarded a grant of EUR 800.000 by the board of the NWO domain science.

CWI starts research project within NWO programme Smart Solutions for Horti- and Agriculture

EU grant for CWI and UCL to improve X-Ray scanning at lower doses with AI

CWI and UCL received an EU ATTRACT grant to deploy and develop AI techniques to improve X-ray CT scanning in such a way that much lower doses of radiation can be used …

EU grant for CWI and UCL to improve X-Ray scanning at lower doses with AI

CWI part of NWA CORTEX consortium

The National Science Agenda has awarded a 5 million euro grant to CORTEX – the Center for Optimal, Real-Time Machine Studies of the Explosive Universe. Self-learning machines will hunt for explosions in …

CWI part of NWA CORTEX consortium

Veni grant for Daniël Pelt

The Netherlands Organisation for Scientific Research (NWO) has awarded a Veni grant to CWI researcher Daniël Pelt.

Veni grant for Daniël Pelt