What is 3D reconstruction?

Definition

A reconstruction system combines evidence from images, video or depth sensors to infer geometry that was not directly measured from one view. It must align camera positions and identify corresponding scene points across observations.

Long videos can provide many viewpoints but also introduce moving objects, changing light and accumulated alignment errors. A coherent result keeps the same structures connected and correctly placed throughout the recovered scene.

ELI5

3D reconstruction builds a three-dimensional representation from pictures, video or sensor measurements. It combines different views to estimate the shape and location of things in a scene.

For example, a long walk-through video can become a 3D model of a building. The system must recognize the same walls and objects across frames so the final geometry does not bend, duplicate or drift apart.

Frequently asked questions

What inputs can be used for 3D reconstruction?

Images, video, depth cameras, lidar and other spatial sensors can provide observations for reconstructing geometry.

Why is long-video 3D reconstruction difficult?

Camera drift, motion, lighting changes and inconsistent feature matches can accumulate and make the recovered scene incoherent.

Videos explaining 3D reconstruction