EPSRC logo

Details of Grant 

EPSRC Reference: EP/N019474/1
Title: Understanding scenes and events through joint parsing, cognitive reasoning and lifelong learning
Principal Investigator: Torr, Professor PH
Other Investigators:
Researcher Co-Investigators:
Project Partners:
Department: Engineering Science
Organisation: University of Oxford
Scheme: Standard Research
Starts: 01 October 2015 Ends: 31 January 2021 Value (£): 1,114,547
EPSRC Research Topic Classifications:
Artificial Intelligence Cognitive Psychology
Image & Vision Computing Vision & Senses - ICT appl.
EPSRC Industrial Sector Classifications:
Information Technologies Aerospace, Defence and Marine
Related Grants:
EP/N019423/1 EP/N019261/1 EP/N019415/1
Panel History:  
Summary on Grant Application Form
The goal of this MURI team is to develop machines that have the following capabilities:

i) Represent visual knowledge in probabilistic compositional models in spatial, temporal, and causal hierarchies augmented with rich attributes and relations, use task-oriented representations for efficient task-dependent inference from an agent's perspective, and preserve uncertainties;

ii) Acquire massive visual commonsense via web scale continuous lifelong learning from large and small data in weakly supervised HCI, and maintain consistence via dialogue with humans;

iii) Achieve deep understanding of scenes and events through joint parsing and cognitive reasoning about appearance, geometry, functions, physics, causality, intents and belief of agents, and use joint and long-range reasoning to fill the performance gap with human vision;

iv) Understand human needs and values, interact with humans effectively, and answer human queries about what, who, where, when, why and how in storylines through Turing tests.

Collaboration with US:

Principal Investigator: Dr. Song-Chun Zhu

Tel. 310-206-8693, Fax. 310-206-5658, email: sczhu@stat.ucla.edu

Institution: University of California, Los Angeles

Statistics and Computer Science

8125 Math Sciences Bldg, Box 951554, Los Angeles, CA 90095

Institution proposal no. 20153924

Other universities in the US

CMU: Martial Hebert Computer Vision, Robotics & AI

Abhinav Gupta Computer Vision, Lifelong Learning

MIT: Joshua Tenenbaum Cognitive Modeling and Learning

Nancy Kanwisher Cognitive Neuroscience

Stanford: Fei-Fei Li Computer Vision, Psychology & AI

UIUC Derek Hoiem Computer Vision, Machine Learning

Yale Brian Scholl Psychology, Cognitive Science

Key Findings
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Potential use in non-academic contexts
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Impacts
Description This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Summary
Date Materialised
Sectors submitted by the Researcher
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Project URL:  
Further Information:  
Organisation Website: http://www.ox.ac.uk