Register now After registration you will be able to apply for this opportunity online.
This opportunity is not published. No applications will be accepted.
Building a high-speed camera! Learning Image reconstruction with an Event Camera
The goal of this project is to turn an event camera into a high-speed camera, by designing an algorithm to recover images from the compressed event stream.
Event cameras such as the Dynamic Vision Sensor (DVS) are recent sensors with large potential for high-speed and high dynamic range robotic applications. The output of an event camera is a sparse stream of events that encode only light intensity changes - in other terms, a highly compressed version of the visual signal.
Event cameras such as the Dynamic Vision Sensor (DVS) are recent sensors with large potential for high-speed and high dynamic range robotic applications. The output of an event camera is a sparse stream of events that encode only light intensity changes - in other terms, a highly compressed version of the visual signal.
The goal of this project is to turn an event camera into a high-speed camera, by designing an algorithm to recover images from the compressed event stream. Inspired by a recent approach, the goal of this project will be to train a machine learning algorithm (or neural network) to learn how to reconstruct an image from the noisy event stream. The first part of the project will consist in acquiring training data, using both simulation and real event cameras. The second part will consist in designing and training a suitable machine learning algorithm to solve the problem. Finally, the algorithm will be compared against state-of-the-art image reconstruction algorithms. The expected candidate should have some background on both machine learning and computer vision (or image processing) in order to undertake this project.
The goal of this project is to turn an event camera into a high-speed camera, by designing an algorithm to recover images from the compressed event stream. Inspired by a recent approach, the goal of this project will be to train a machine learning algorithm (or neural network) to learn how to reconstruct an image from the noisy event stream. The first part of the project will consist in acquiring training data, using both simulation and real event cameras. The second part will consist in designing and training a suitable machine learning algorithm to solve the problem. Finally, the algorithm will be compared against state-of-the-art image reconstruction algorithms. The expected candidate should have some background on both machine learning and computer vision (or image processing) in order to undertake this project.
Henri Rebecq (rebecq at ifi.uzh.ch), Guillermo Gallego (guillermo.gallego at ifi.uzh.ch)
Henri Rebecq (rebecq at ifi.uzh.ch), Guillermo Gallego (guillermo.gallego at ifi.uzh.ch)