Using Diffusion Models for Tomographic Imaging

We are looking for students who have a strong background in computational imaging or a related field, while a basic understanding of probability, inference, and generative AI is important. Familiarity in Python and deep learning frameworks such as PyTorch is also required.

Project description

Diffusion models have recently revolutionized image generation and are increasingly used as learned priors to recover missing information in inverse imaging problems. Computed Tomography (CT) reconstruction is one such problem, where information loss can occur due to limited measurements, motion, or dose constraints. Applying diffusion models to CT is a promising but non-trivial task, as these models usually require large training datasets, the pretrained models have mostly been trained on natural images or videos, and combining image generation with the physics of CT is not always straightforward. These open several interesting research directions.
In this project, you will choose from a few possible research directions: leveraging off-the-shelf video diffusion models for dynamic CT, noise schedule design for balancing learned prior and physics, or developing diffusion bridges that mimic the progressive CT acquisition process. Other related ideas on these topics are also welcome to discuss. Depending on the chosen direction, the work will either show how existing diffusion models can be leveraged for tomography without large CT datasets, or propose alternative strategies to achieve high-quality reconstructions under limited data conditions.

Supervision & focus areas

Supervisor : Tristan van Leeuwen (CWI),

Keywords : tomographic imaging, inverse problems, diffusion models

Second release ASTRA toolbox

The new version of ASTRA, co-developed at CWI, offers improvements in compatibility and interoperability with other toolboxes.

Second release ASTRA toolbox

CWI podcast: How the FleX-ray scanner reveals art secrets

The science podcast "How CWI's FleX-ray scanner reveals art secrets" is now online. CWI PhD candidate Francien Bossema (CI) and Rijksmuseum professor Erma Hermens talk to science journalist Bennie Mols about our …

podcast bossema nieuw

CT scan by CWI reveals hidden double-panel painting from Rubens studio

CT scans of a Rijksmuseum panel painting in CWI’s FleX-ray laboratory have revealed a surprising insight: it turns out it was not painted on oak, as was always assumed, but on tropical …

CT scan by CWI reveals hidden double-panel painting from Rubens studio

IMPACT4ART: the interplay between scientists, art historians, conservators and the general public

The wooden sculpture shown in the green oval is surrounded by mystery: How old is this wooden sculpture? Where and by whom was it made? Mathematics and computer science can help to …

CWI algemeen 2022 09 06-139

Cycling & Mathematics: why Wilco Kelderman lost a minute or more to the early starters of the Giro 2020 …

Cycling pro Wilco Kelderman is a good individual time trialist and he said in his post-race interview that he felt he rode a great prologue at the Giro 2020. Knowing this, we …

james-thomas-7u1SFd5AL7I-unsplash

Quest for the Hugo de Groot book chest

Rijksmuseum Amsterdam was pursuing an interesting question: in which book chest did Hugo de Groot escape from castle Loevestein in 1621? The Rijksmuseum and University of Amsterdam turned to CWI for help …

Quest for the Hugo de Groot book chest

Insight in Wood: dating wooden objects with 3D CT imaging

Together with the Rijksmuseum, researchers of CIW's Computational Imaging group investigate art objects with the help of our state of the art FleX-ray scanner. PhD student Francien Bossema explains how they proceed.

CI Flex lab

Best Poster Prize for Allard Hendriksen

Allard Hendriksen, researcher at CWI’s Computational Imaging group was awarded the Best Poster Prize at the “Mathematics of Machine Learning” symposium.

Best Poster Prize for Allard Hendriksen