Using Diffusion Models for Tomographic Imaging

We are looking for students who have a strong background in computational imaging or a related field, while a basic understanding of probability, inference, and generative AI is important. Familiarity in Python and deep learning frameworks such as PyTorch is also required.

Project description

Diffusion models have recently revolutionized image generation and are increasingly used as learned priors to recover missing information in inverse imaging problems. Computed Tomography (CT) reconstruction is one such problem, where information loss can occur due to limited measurements, motion, or dose constraints. Applying diffusion models to CT is a promising but non-trivial task, as these models usually require large training datasets, the pretrained models have mostly been trained on natural images or videos, and combining image generation with the physics of CT is not always straightforward. These open several interesting research directions.
In this project, you will choose from a few possible research directions: leveraging off-the-shelf video diffusion models for dynamic CT, noise schedule design for balancing learned prior and physics, or developing diffusion bridges that mimic the progressive CT acquisition process. Other related ideas on these topics are also welcome to discuss. Depending on the chosen direction, the work will either show how existing diffusion models can be leveraged for tomography without large CT datasets, or propose alternative strategies to achieve high-quality reconstructions under limited data conditions.

Supervision & focus areas

Supervisor : Tristan van Leeuwen (CWI),

Keywords : tomographic imaging, inverse problems, diffusion models

Best presentation award for Francien Bossema at AmeriDendro

The prize was awarded for the presentation 'Applications and advances in X-ray Computed Tomography (CT) for dendrochronology'.

CWI algemeen 2022 09 06-135

An inspiring masterclass on machine learning for inverse problems

CWI organised a 2-day masterclass, as part of the CWI Semester Program on Data-driven methods for Inverse Problems. Participants from Groningen to Paris attented the event.

CWI Algemeen 20 10 04-113

Algorithms can also learn without examples

Allard Hendriksen (CWI) developed an algorithm that improves X-ray images without having to learn from data from previous measurements. He defends his PhD thesis on 3 March at Leiden University.

data_computing_shutterstock

CWI scanner revealing art secrets seeks new applications

CWI and Rijksmuseum are exploring the possibilities of CWI's 3D FleX-ray scanner together.

CWI scanner revealing art secrets seeks new applications. Image: Shutterstock.

Developing Improved Breast Cancer Imaging Techniques

Breast Cancer is the most common cause of cancer death in women worldwide. Felix Lucka from the Computational Imaging group at CWI is part of a European research team that develops novel …

Developing Improved Breast Cancer Imaging Techniques

First annual meeting of Dutch Inverse Problems community

A mathematician, a statistician and a physicist gather in a room…” sounds like the beginning of a joke. It was, however, the main ingredient of a very successful first annual meeting of …

First annual meeting of Dutch Inverse Problems community

NWO Team Science Award for CWI with UvA and Rijksmuseum

A team of researchers from CWI, Universiteit van Amsterdam (UvA), Rijksmuseum and Universiteit Leiden (UL) have been awarded the first NWO Team Science Award for their research on the Hugo de Groot …

NWO Team Science Award for CWI with UvA and Rijksmuseum

Scanning volcanic rocks in our FleX-Ray lab

The FleX-ray CT-scanner located at the CWI, is a flexible system that can scan a large range of different objects. Even volcanic rocks!

Scanning volcanic rocks in our FleX-Ray lab