Low Compute and Fully Parallel Computer Vision with HashMatch
Depth cameras are becoming key tools for computer vision tasks ranging from hand, body or object tracking, 3D reconstruction and simultaneous localization and mapping. Almost all these tasks need to solve a *tracking* problem i.e. each new frame of depth and image data is correlated to the previous, and this temporal information allows for faithful pose and/or geometry reconstruction over time. However, this reliance on temporal information, makes tracking problems hard to solve when using sensors running at 30fps, due to susceptibility to high frame-to-frame scene motions and artifacts such as motion blur. Using high speed depth cameras would greatly simplify these problems and make them more tractable, but despite significant research efforts, no existing high framerate and high quality depth algorithm, and hence camera exists.
In this talk I am going to demonstrate a 3D capture system for high speed and high quality depth estimation, and show its advantages in a variety of computer vision tasks. Our hardware and software depth pipeline can run at 1.1msec with modern GPUs and readily procurable camera and illumination components.
Short Bio
Sean Ryan Fanello has received his Bachelor and Master degrees from Sapienza where he worked on 3D Reconstruction and Gesture Recognition. He received his PhD in Robotics from Italian Institute of Technology where he designed and implemented the iCub perception system. In particular, he worked on algorithms for 3D estimation, hand-eye calibration, egomotion estimation, action recognition and object recognition. After his PhD, he spent 3 years at Microsoft Research. His research is mainly focusing on the intersection among Machine Learning, Computer Vision and Natural User Interfaces. At Microsoft he has developed new technologies for 3D estimation that have been deployed on the Microsoft Hololens headset. He was one of the leading members of important projects like Holoportation where they showed the first 3D telepresence system with HD quality. Holoportation, enables real-time ''teleportation'' of people from anywhere in the world allowing them to communicate fully in 3D. Recently he is a founding team member of perceptiveIO. At perceptiveIO he is developing novel 3D sensing capabilities, natural user interfaces and computer vision applications.