I am a 3rd year PhD student at UNC Chapel Hill, advised by professor Henry Fuchs.
We want to democratize telepresence by building desktop systems at a low cost.
I did my undergrad at University of Illinois Urbana-Champaign (UIUC), where I first learned 3D vision from
professor Derek Hoiem . I then went to CMU for Master
in Computer Vision (MSCV). After working with professor
Michael Kaess and Dr. Lipu Zhou at CMU, I returned to UIUC
to work for Reconstruct founded by
professor Derek Hoiem and professor
Mani Golparvar-Fard. At Reconstruct,
I gained a lot more experience in traditional 3D reconstruction and SLAM, and I got my first patent. Much
love to everybody at Reconstruct : ). I love every second there.
We showcase a prototype personal telepresence system. With 4 RGBD cameras, it can be easily
installed on every desk. Our renderer synthesizes high-quality free-viewpoint videos of the
entire scene and outperforms prior neural rendering methods.
We discovered a natural information partition in 2D/3D MLPs, which stores structural
information in early layers and color information in later layers.
We leverage this property to incrementally stream dynamic free-viewpoint videos without buffering
(required by prior dynamic NeRFs).
With the significant reduction in training time and bandwidth, we lay foundation for live-streaming
NeRF and better understanding of MLPs.