Niantic Research at CVPR 2024 - Accurate Plane Estimation via 3D-Consistent Embeddings

June 08, 2024

At CVPR 2024, Niantic researchers will present “AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddings”, a paper focusing on a challenging yet essential task: identifying the flat surfaces in a 3D scene from pictures taken at different angles. To identify planes in a 3D scene, AirPlanes uses a 3D mesh of the scene obtained by running Niantic’s state-of-the-art real-time depth prediction system. Once this 3D mesh is created, geometric cues can be used to identify the planes in the scene. For example, a closed door and the wall enclosing it should be assigned different planes, because they have different semantic meanings. However, that is not possible to do from geometric cues only.

The source of this news is from Niantic