Meta AR/VR Job | Research Scientist, Image Signal Processing & Sensor Calibration (PhD)

Job（岗位）: Research Scientist, Image Signal Processing & Sensor Calibration (PhD)

Type（岗位类型）: 3D Product Design | Computer Vision, Hardware, Research

Citys（岗位城市）: Redmond, WA | Burlingame, CA

Date（发布日期）: 2022-1-27

Summary（岗位介绍）

Reality Labs brings together a world-class team of researchers, developers, and engineers to create the future of virtual and augmented reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect.We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interface, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives.

The Sensors & Systems Research group at Reality Labs Research is seeking exceptional Research Scientists to solve research challenges on the path to building future machine perception enabled sensor technologies. The aim of this role is to analyze, develop and advance image signal processing algorithms for improved sensor performances in applications including SLAM, eye tracking and so on.

Qualifications（岗位要求）

Currently has, or is in the process of obtaining a Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.

Knowledge/experience with image signal processing (camera ISP and algorithm).

Experience with image data analysis focusing on noise and SNR.

Proficient in C, C++, Python.

Basic knowledge of computer vision and AI applications.

Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.

Currently has, or is in the process of obtaining, a PhD in electrical engineering, computer science, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.

Description（岗位职责）

Collect and/or analyze image data from custom and OTS image sensors in lab and real-world environment.

ISP performance modeling and proof of concept with real or synthesized data.

Validate and correlate ISP hardware and software implementation.

Share image analysis result to improve future sensor and ISP architecture.

Develop, modify, and optimize ISP algorithms based on AR/VR application requirements and sensor performance studies/evaluations.

Author technical reports for internal review and signoff.

Collaborate with internal and external partners in the deliverable and integration of ISP reference model.

Collaborate with a diverse team of computer vision scientists, hardware and software architects, optical experts, and ME/EE researchers to prototype and optimize novel vision systems.

Large volume data online processing

handle data between cloud servers, supporting internal and external partners in accessing data for camera and system development.

Additional Requirements（额外要求）

MATLAB skill and experience.

Knowledge of RS and GS image sensor operation, characteristics, and noise sources.

Familiar with camera noise correction algorithms and techniques.

Experience with camera data collection and ISP optimization.

Understanding of HDR image algorithms, reconstruction and tone mapping.

Knowledge of PHP language.

Demonstrated independent research capabilities through research report, thesis/dissertation, technical report and publications in areas including but not limited to sensor system fusion, image processing and algorithm development, and AR/VR relevant applications (such as SLAM, eye tracking, body tracking, AI).

Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ECCV/ICCV, SIGGRAPH, or similar.

Experience working and communicating cross functionally in a team environment.