[CURATED] An Integrated 6DoF Video Camera and System Design Platinum Pass Full Conference Pass Full Conference One-Day Pass Basic Conference Pass Student One-Day Pass Experience Pass Exhibitor Pass [CURATED] An Integrated 6DoF Video Camera and System Design Presenter(s): Albert Parra Pozo, Facebook, United States of AmericaMichael Toksvig, Facebook, United States of AmericaTerry Filiba Schrager, Facebook, United States of AmericaJoyce Hsu, Facebook, Uday Mathur, RED Digital Cinema, United States of AmericaAlexander Sorkine-Hornung, Facebook, United States of AmericaRichard Szeliski, Facebook, United States of AmericaBrian Cabral, Facebook, United States of AmericaKevin Dale, Facebook, United States of America Description: Designing a fully integrated 360◦ video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our demo is the first to show a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering. Bio of Speaker(s): Back
