EPSRC logo

Details of Grant 

EPSRC Reference: EP/P003818/2
Title: Coupling and Control in Continuous Time
Principal Investigator: Mijatovic, Dr A
Other Investigators:
Researcher Co-Investigators:
Dr M Vidmar
Project Partners:
Department: Statistics
Organisation: University of Warwick
Scheme: Standard Research
Starts: 01 August 2018 Ends: 31 October 2019 Value (£): 159,934
EPSRC Research Topic Classifications:
Mathematical Analysis Numerical Analysis
Statistics & Appl. Probability
EPSRC Industrial Sector Classifications:
No relevance to Underpinning Sectors
Related Grants:
EP/P00377X/1
Panel History:  
Summary on Grant Application Form
Randomness is ubiquitous in the natural world, and advances in understanding and modelling random events are key to making progress with many problems in the natural and social sciences, engineering, statistics, to name but a few. Coupling is a fundamental paradigm in probability through which probability distributions of random quantities (random variables, random processes) can be compared with each other via "pointwise" comparisons. It yields powerful techniques for analysing random systems.

A Markov process is a random process whereby, conditional on the present, its future and past are independent. That is, if we know the present state of the process, we can gain no additional information on its future evolution by knowing more about its past. This paradigm describes many random processes used as models in the natural and social sciences. In coupling we are looking at two Markov processes that start from different locations and evolve jointly. We are interested in them meeting a number of criteria, e.g. the two processes meeting as soon as possible, staying close to each other for as long as possible, or other criteria (e.g. the large deviation behaviour of the coupling time, i.e. what the exponential rate of decay of the coupling time is). As well as being an interesting mathematical question in and of itself, this problem has significant potential applications. For example, the rate of convergence to stochastic equilibrium (a crucial question in many applications) is controlled by the rate at which coupling occurs.

There is a natural lower bound in the speed of coupling. The "fastest" couplings, i.e. the couplings where the probability that the two processes have not met by any given time is smallest, are known as "maximal" couplings: one can construct those by defining the second process as a functional of the entire trajectory of the first. However, in the context of modelling in the sciences, it is natural to focus on co-adapted couplings, namely couplings whereby the second process at a given time can only be constructed based on the trajectory of the first upto and including the present time (i.e. no information about the future trajectory of the first process can be taken into account).

The difficulty here is that it is hard to obtain optimal (called "extremal") couplings. In fact it's difficult to know how good any given co-adapted coupling is. This proposal is about taking any co-adapted coupling and providing a method of improving it. Not just locally, but proving mathematically that the sequential improvements we propose yield a co-adapted coupling that is as good as it can get. Essentially we are looking to solve a stochastic optimisation problem under the additional constraint of co-adaptivity.

In this proposal, the main method for improving a co-adapted coupling to achieve optimality is via the application of control theory. We aim to use the Policy Improvement Algorithm, a tool from control theory that works in discrete time, and develop its application in continuous time. In the application part of the project, we aim to develop applications of the PIA in the theory of non-linear PDEs and Multi-Level Monte Carlo (MLMC) algorithms for processes with jumps. The areas of non-linear PDEs and MLMC simulation have applications with vast societal and economic impact: the former has applications in biology, physics, engineering to name a few, and the latter is of crucial importance in Uncertainty Quantification in engineering and science. When the uncertainty is high-dimensional and strongly nonlinear, Monte Carlo simulation remains the preferred approach, with applications in areas as diverse as biochemical reactions and plasma physics.
Key Findings
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Potential use in non-academic contexts
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Impacts
Description This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Summary
Date Materialised
Sectors submitted by the Researcher
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Project URL:  
Further Information:  
Organisation Website: http://www.warwick.ac.uk