Meta AR/VR Job | Tech Lead, Applied Research CV & Machine Perception

Job(岗位): Tech Lead, Applied Research CV & Machine Perception

Type(岗位类型): Computer Vision | Machine Learning

Citys(岗位城市): Sunnyvale, CA | Redmond, WA

Date(发布日期): 2022-1-14


Facebook Reality Labs Research (FRL-R) brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today.

The technology that is being developed within the Surreal team at FRL-R is a new generation of end-to-end real-time 3D object & scene understanding systems working across novel mobile sensor design, sensor fusion, state estimation, computer vision, large-scale reconstruction and localization, as well as large-scale online inference and optimization.

The Surreal Index team is seeking an exceptional experienced senior engineer and tech lead, with deep expertise in 3D object detection and 6D pose estimation. The expectation is to lead a group of world-class researchers and engineers to perform applied research and push the boundaries with new architectures, scalable ML detection systems and training approaches with synthetic and real data.


9+ years of software engineering work experience in commercial environments, including 3+ years experience of leading multidisciplinary teams to deliver machine perception features

6+ years of experience with real world system building, including design, coding (C++/Python) and evaluation/testing (C++/Python)

5+ years of experience in Object detection, Pose estimation, 3D Computer Vision algorithms, Reconstruction, Tracking and Deep Learning Frameworks

PhD degree in the following fields: Computer Science, Software Engineering, Computer Vision, Robotics, 3D Reconstruction

Currently has, or is in the process of obtaining a Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.


Plan and execute innovative engineering development to advance the state of the art in machine perception and 3D object & scene understanding in AR/VR systems

Collaborate closely with researchers and engineers across both machine and human perception teams at Facebook to design prototypes, and concepts related to multi-user object detection and tracking systems distributed across cloud and embedded devices at scale

Establish a comprehensive and deep technical understanding of LiveMaps Index and existing infrastructures within FB and industry, to help the Index team to make informed decisions

Architect and communicate designs for Index services running both on embedded devices and cloud

Set the direction and goals for the team, in terms of project impact, product quality, and engineering efficiency

Lead design/technical direction, quality efforts, code reviews with the team and give clear and actionable feedback on a timely basis

Gather use cases from both internal research teams and cross-functional partners to have a clear picture of the requirements for the Index platform

Given the set of requirements, help formulate a coherent roadmap that delivers features in a progressive, incremental fashion

Work closely with Index EMs and across the Surreal team to form dynamic virtual teams to pull together research features on the roadmap into end-to-end systems

Set concrete goals and priorities with ranked features as clear expectations for the team to execute on

Help recruit new members to grow the team from bootcamp, industry/academia and onboard new members into the team, by mentoring them and making it easy to ramp up in the team’s codebases and infra

Communicate proactively, effectively, and efficiently, both vertically within the Surreal Index, and horizontally across different teams not only within Surreal, but also in cross-functional collaborations

Proactively learn the bigger context, and bring the right level of context wherever necessary to increase the Index team’s clarity and visibility

The candidate will be responsible for helping Index EMs drive/orchestrate cross-functional collaborations, to understand their requirements and roadmap, identify commonalities, and further influence their development to accelerate the goals for the overall LiveMaps mission

The candidate should help the cross-functional collaboration establish alignment on those investments and help the Surreal team to negotiate tech transfer, consolidation and long-term support plans wherever there is opportunity

Additional Requirements(额外要求)

Experience with designing (products or open-source) software for robotic or AR/VR devices

Experience in real-time computer vision or modern GPU programming (CUDA, OpenGL, OpenCL)

Experience designing or developing complex cloud integrated machine perception architectures

Experience in embedded devices

Experience working in a Unix environment