..
E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control
Qiao Gu, Lingni Ma, Adam W. Harley, Richard Newcombe, Florian Shkurti, Julian Straub
E3C generates controllable, physically grounded egocentric video by disentangling persistent scene structure from human-driven dynamics. It builds a semi-dense point-cloud 3D memory of the environment and renders ego- and exo-skeletons for human pose control, improving visual fidelity, camera-motion accuracy, object consistency, and human control.