Meta AR/VR Job | Research Engineer, 3D Graphics Simulation and Rendering for Synthetic CV/ML Data

Job(岗位): Research Engineer, 3D Graphics Simulation and Rendering for Synthetic CV/ML Data

Type(岗位类型): 3D Software Engineering | Computer Vision, Research

Citys(岗位城市): Redmond, WA | Remote, US

Date(发布日期): 2022-1-13


Meta Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as ubiquitous and essential as smartphones and personal computers are today.

The technology that is being developed within the Surreal team at RL-R is a new generation of spatial and contextual AI capabilities working across devices, software and infrastructure which we collectively refer to as LiveMaps.

The Surreal Index team is seeking an exceptional research engineer, with expertise in real-time simulation, high performance 3D graphics, or synthetic data generation. The expectation is to work with a group of applied researchers, engineers and contingent workers to implement both real-time and offline, scalable, simulation of photorealistic dynamic real-world and virtual scenes and physical devices, using commercial game engines such as Unreal Engine, or cloud based commercial off the shelf solutions such as NVidia Omniverse, or simulation technology developed in-house.


Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

5+ years software engineering, 3D graphics or graphical simulation work experience in commercial environments or game development

4+ years experience with real world system building, including software design, coding and evaluation/testing (C++/C#)

4+ years experience in real-time 3D graphical simulation or rendering, and modern GPU programming (CUDA/OpenGL/OpenCL) or shader programming, or with physics engines such as Havok and PhysX


Design and build scalable synthetic data generation systems to requirements, focusing on graphical simulation of AR/VR device sensors and scalable systems for Computer Vision and Machine Learning training and test data creation

Plan and execute Implementation of real-time, physically based simulation of a living, breathing world populated with people and objects with scriptable, triggerable environmental events and changes, including dynamic simulations of time-of-day, weather and seasons, dynamic simulations of ambient traffic and people, and third person and egocentric AI controllers of human agents

Hardware in the loop and system in the loop simulation blending real physical components with simulated components in a working system

Drive down power, latency, and costs by optimizing simulation pipelines

Establish a deep technical understanding of Livemaps related science and FB infrastructures

Architect and communicate designs for scalable real-time and offline simulation running on local PCs, on-premises clusters, and cloud

Formulate coherent roadmaps with timelines that deliver features to high quality with efficiency in a progressive, incremental fashion on a timely basis to ensure project impact

Communicate simulated data generation status, feature plans and roadmaps proactively, effectively, and efficiently, both within the team, and in cross-functional collaborations

Help recruit new members and onboard new members into the team, by mentoring them and making it easy to ramp up in the team’s codebases and infra

Additional Requirements(额外要求)

Masters or PhD in in the following fields: Computer Science, Software Engineering, 3D Computer Graphics, Computer Game Development, Computer Vision, Robotics, or a related field

Experience contributing to (product or open-source) software for 3D games, robotics or AR/VR devices

Experience with Unreal Engine or NVidia Omniverse

Expertise in real-time Animation, animation controllers, behavioral scripting, game AI, engine technology and gameplay programming using popular game engines

Experience with 3D graphics and rendering, including emerging ML based representations and techniques such as NeRF

Experience in engineering scalable, distributed rendering systems and cloud services

Experience working in Linux and Windows environments across PC and cloud

An interest for rendering, game engines and the technology that allows them to scale in fidelity and size, tools that accelerate content creation, and systems that allow for a rapid iteration