| EPSRC Reference: |
EP/Y018273/1 |
| Title: |
Theory for Denoising Diffusion Models: generalisation and sample complexity |
| Principal Investigator: |
DELIGIANNIDIS, Professor G |
| Other Investigators: |
|
| Researcher Co-Investigators: |
|
| Project Partners: |
|
| Department: |
Statistics |
| Organisation: |
University of Oxford |
| Scheme: |
New Investigator Award |
| Starts: |
31 May 2024 |
Ends: |
30 May 2027 |
Value (£): |
524,406
|
| EPSRC Research Topic Classifications: |
| Non-linear Systems Mathematics |
Statistics & Appl. Probability |
|
| EPSRC Industrial Sector Classifications: |
| No relevance to Underpinning Sectors |
|
|
| Related Grants: |
|
| Panel History: |
|
|
Summary on Grant Application Form |
Modern society is faced with an abundance of data, ranging from audio, images, and videos captured on our smartphones to massive datasets containing social media networks and medical information for millions of patients. One of the primary objectives of artificial intelligence (AI) is to design systems that can recognize patterns and extract meaning from such datasets, a task at which humans excel.
Generative modelling, an active topic in machine learning and AI, aims to learn how to generate new samples from an unknown distribution, having access only to samples from that distribution.
Generative models have numerous applications, including anomaly detection, lossless compression, generating realistic images with specific features, filling in missing parts or improving the resolution of images captured by cameras on our phones. Generative models are also routinely used as scientific tools by researchers working on drug discovery, protein structure discovery, molecular design, medical imaging and many more disciplines.
Perhaps the best known example of a generative model is the recent ChatGPT (Generative Pre-trained Transformer) chatbot. ChatGPT is a highly sophisticated generative model that can
hold realistic conversations and even write computer code!
In the past decade, generative modelling has made tremendous progress, largely due to advancements in neural networks and deep learning. While several key algorithms have emerged, until recently, the most successful approach thus far has been Generative Adversarial Networks (GANs). In fact GANs remained the best approach until the recent emergence of Score-based Generative Models (SGMs), specifically Denoising Diffusion Models (DDMs). DDMs are now the dominant class of generative models, achieving state-of-the-art results in many applications, including image generation. DDMs are routinely used to generate text, audio, solve inverse problems, medical imaging, and even for protein structure discovery. The tremendous success and popularity of these models has generated a critical need to comprehend their statistical properties and their ability to generate new samples from unknown target distributions. Despite recent advancements we presently lack a precise explanation for the observed empirical success of these models.
The goal of this project is to bridge this gap in our understanding and develop a theoretical framework that underpins the success of DDMs. With the expanding influence of AI, particularly generative models, on contemporary society, this project is timely and holds significant potential for making a profound impact in academia and beyond.
|
|
Key Findings |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
|
Potential use in non-academic contexts |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
|
Impacts |
|
| Description |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk |
| Summary |
|
| Date Materialised |
|
|
|
|
Sectors submitted by the Researcher |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
| Project URL: |
|
| Further Information: |
|
| Organisation Website: |
http://www.ox.ac.uk |