Meta AR/VR Job | Research Scientist - Neural Rendering
Job（岗位）: Research Scientist - Neural Rendering
Type（岗位类型）: 3D Software Engineering | Artificial Intelligence, Computer Vision, Data Engineering, Engineering, Machine Learning, Research
Citys（岗位城市）: Sausalito, CA
Date（发布日期）: Before 2021-12-14
Summary（岗位介绍）
For AR/VR communication to be a success, it has to continue the tradition of phone and video calling: you’re hearing and seeing what the other person sounds and looks like. Our goal is to create a truly photographic experience for communication. For this, we are exploring ways to render a digital representation of a user that is high fidelity and highly realistic. And to do this Facebook is exploring completely new ways of thinking about rendering.
In this position, we want to research and explore using machine learning neural rendering techniques to work in conjunction with the latest technology in rendering to produce a digital representation of a user that is as immediate and accurate as a video of a user. The ideal candidate will have a strong understanding of computer graphics and machine learning techniques with an emphasis on image-to-image translation.
Qualifications（岗位要求）
5+ years of work experience working with game engines in the games or movie industry
Experience working with shading pipelines
Solid understanding of the rendering and shading stack of game engines
Solid understanding of multi-process and GPU architectures
A broad understanding of machine learning techniques
A broad understanding of challenges in rendering, in particular for AR/VR applications
Communication and organizational skills
Demonstrated experience working with minimal supervision to complete tasks
Exhibiting listening and communication skills, experience receiving direction and criticism
Demonstrated experience working collaboratively within a team environment
Experience picking up new techniques and experience learning new software quickly and easily
Experience working with and expanding the usability of new research software
Description（岗位职责）
Develop new ways of rendering the head, hair and body of a user in a highly photographic manner
Research techniques for combining image-to-image translation and deferred neural rendering with highly accurate traditional rendering techniques
Build prototypes and demos of real-time image-to-image enhanced digital humans
Research disentangling the components of an image: lighting, pose, expression and identity
Research techniques to quickly create 3D real-time representations of the user as they are in the moment
Additional Requirements（额外要求）
Experience with some high level shading languages (RSL, OSL, HLSL, AZSL), Python, CUDA C, C++, PyTorch
