Meta AR/VR Job | Research Engineer Intern, XR Map Building/On-device Mapping (PhD)

Job(岗位): Research Engineer Intern, XR Map Building/On-device Mapping (PhD)

Type(岗位类型): Computer Vision | Engineering, Research

Citys(岗位城市): Burlingame, CA

Date(发布日期): Before 2021-12-14


Quest headsets currently operate inside single rooms and don’t expect tracking to drift when building the map of their environment. We would like to modify our SLAM system to handle larger environments while still matching the quality and experience users get with single rooms today. We want our headsets to operate in an entire home, outside, or in a large venue like an airport or mall. Achieving this requires us to have minimal memory usage, minimal compute for this to be even feasible on device. This requires the development of two key technologies we are missing today, loop closure, and map streaming to disk. These are not new, but the challenge is in making them fast, reliable; thus we desire studying methods to approximate the problem to make them work on production hardware. Interns will develop and test their ideas for loop closure and map streaming, concluding with a demo and presentation of their work to the Map Building organization.


Currently has, or is in the process of obtaining a PhD degree in the field of Computer Science.

1 year of C++ experience.

Basic knowledge of Nonlinear Least Square optimization.

Excellent communication and collaboration skills.

Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.


Authoring C++ module and completing unit tests to verify work.

Offline and on-device demonstration of VR headset operating in a large environment.

Study of local loop closure / map streaming and methods to reduce computation.

Generation of pseudo ground truth methods to vet solutions.

Presentation of findings.

Additional Requirements(额外要求)

Experience in SLAM, Visual-inertial odometry.

Experience with C++ template meta programming.

Experience with Android / VR development.

Experience in open-source optimization libraries like Ceres library.

Experience in open-source math libraries like Eigen.

A publication record in peer-reviewed conferences, eg. CVPR, ICCV, ECCV, ISMAR, ICRA.

Intent to return to a degree-program after the completion of the internship.