Using Diffusion Models for Tomographic Imaging

We are looking for students who have a strong background in computational imaging or a related field, while a basic understanding of probability, inference, and generative AI is important. Familiarity in Python and deep learning frameworks such as PyTorch is also required.

Project description

Diffusion models have recently revolutionized image generation and are increasingly used as learned priors to recover missing information in inverse imaging problems. Computed Tomography (CT) reconstruction is one such problem, where information loss can occur due to limited measurements, motion, or dose constraints. Applying diffusion models to CT is a promising but non-trivial task, as these models usually require large training datasets, the pretrained models have mostly been trained on natural images or videos, and combining image generation with the physics of CT is not always straightforward. These open several interesting research directions.
In this project, you will choose from a few possible research directions: leveraging off-the-shelf video diffusion models for dynamic CT, noise schedule design for balancing learned prior and physics, or developing diffusion bridges that mimic the progressive CT acquisition process. Other related ideas on these topics are also welcome to discuss. Depending on the chosen direction, the work will either show how existing diffusion models can be leveraged for tomography without large CT datasets, or propose alternative strategies to achieve high-quality reconstructions under limited data conditions.

Supervision & focus areas

Supervisor : Tristan van Leeuwen (CWI),

Keywords : tomographic imaging, inverse problems, diffusion models

Unique scanner unveils art and other secrets

Since 2017 CWI operates the FleX-ray scanner, a custom-made, fully-automated X-ray CT scanner with applications in cultural heritage, industry, healthcare and science.

CI Flex lab

Less food waste through automated quality control

Agricultural products typically have more variation within the same batch of products than processed foods. The development of advanced imaging techniques makes it possible to improve the accuracy of agricultural product quality …

CI Flex lab

CWI hosts 4th International Workshop on Medical Ultrasound Tomography

Ultrasound Tomography is an emerging medical imaging technique that is almost ready to be used in a clinical setting. The biennial Workshop on Medical Ultrasound Tomography (MUST) brings together research groups from …

breast_cancer_sketch

Photosynthetic finalist in prestigious Hello Tomorrow Global Challenge

Out of more than 4,000 international participants, CWI spin-off Photosynthetic has been selected as a finalist in the Hello Tomorrow Global Challenge. The pioneer in micro-3D printing technology is one of the …

photosynthetic2

CWI’s lectures on Digital Cultural Heritage

Where mathematics, computer science and humanities meet.

CWI Algemeen 2022 09 29-021

Tristan van Leeuwen appointed as Professor of Computational Inverse Problems

Utrecht University has announced the appointment of Tristan van Leeuwen as professor of Computational Inverse Problems, starting from 1 October.

Tristan van Leeuwen

Blogpost: behind the paper

In this blog post PhD researcher Maximilian Kiss shares the personal journey and the story behind the paper ‘2Detect – A large 2D expandable, trainable, experimental Computed Tomography data collection for machine …

CWI Algemeen 2022 09 15-009

Identifying the creator of an artwork by fingerprint examination

Researchers used CWI’s FleX-ray scanner to examine a Rijksmuseum statue and discovered the characteristics of the artist.

statue in flexray