EPSRC logo

Details of Grant 

EPSRC Reference: EP/Y023048/1
Title: On-Sensor Computer Vision
Principal Investigator: Dudek, Professor P
Other Investigators:
Researcher Co-Investigators:
Project Partners:
Intel Corporation Ltd Sony Semiconductor Solutions Corporation
Department: Electrical and Electronic Engineering
Organisation: University of Manchester, The
Scheme: Standard Research
Starts: 01 June 2024 Ends: 31 May 2028 Value (£): 1,327,360
EPSRC Research Topic Classifications:
Fundamentals of Computing Image & Vision Computing
Information & Knowledge Mgmt Instrumentation Eng. & Dev.
Software Engineering
EPSRC Industrial Sector Classifications:
Information Technologies
Related Grants:
EP/Y020499/1 EP/Y022629/1
Panel History:
Panel DatePanel NameOutcome
25 Sep 2023 EPSRC ICT Prioritisation Panel Sept 2023 Announced
Summary on Grant Application Form
Bringing advanced computer vision to edge devices such as robots, consumer electronics, or sensor networks is challenging due to the constraints of power, size and communication bandwidth under which they often operate. We propose vertically integrated research into the paradigm of on-sensor computer vision, where sensing and processing are unified into single chip which produces abstract, information-rich output rather than images. We aim to demonstrate that on-sensor computer vision can be much more powerful and general than seen in previous research, and that the correct hardware design, software framework and algorithm choices permit switchable or even simultaneous computation of a broad set of vision competences (such as motion estimation, segmentation and scene classification) on a single device. We propose to work on the design of on-sensor computer vision systems through a programme of work from pixel-processing architecture design and microelectronic hardware implementation, through software platform development, to unified algorithm design and experimentation to determine how to use this hardware in a full application. This will enable camera devices that not only capture images, but have a powerful built-in vision capability to understand what they are looking at, and ultimately can go from light to decision on a single sensor/processor chip, with unprecedented speed, low power consumption and small footprint. We hope to open up a new class of edge applications where cameras can be much more efficient and independent, or for smart cameras to be used in ways never previously considered.

Key Findings
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Potential use in non-academic contexts
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Impacts
Description This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Summary
Date Materialised
Sectors submitted by the Researcher
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Project URL:  
Further Information:  
Organisation Website: http://www.man.ac.uk