Meta AR/VR Job | Research Scientist – Auditory Attention/Source Selection (PhD)

Job(岗位): Research Scientist – Auditory Attention/Source Selection (PhD)

Type(岗位类型): Computer Vision | Machine Learning, Research

Citys(岗位城市): Redmond, WA

Date(发布日期): Before 2021-12-14


Facebook Reality Labs has embarked on a mission to build the next computing platform in augmented and virtual reality systems. Our goals are to eliminate distance, reduce cognitive load and help people become more productive, replace physical objects, and give people the tools to feel more connected anytime and anywhere. We believe that a key component of this mission is to improve and enhance human hearing, including listening in challenging environments and telepresence. We are looking for an exceptional Research Scientist to join our growing interdisciplinary team, working to prototype solutions to difficult problems at the intersection of hearing, hearing impairment, auditory perception, spatial audio, and signal processing.

We are engaging in a long-term project to use state of the art behavioral capture techniques to examine how people communicate, both unassisted and assisted with devices that can alter the sound field (and consequently intelligibility and behavior). The long-term goal here is to use behavioral, biosignal, and physical sensor data to enable our superhuman hearing devices to make the best choices about what sounds we need to enhance and what sounds we need to suppress to maximize the intelligibility of speech in noisy backgrounds.

This full-time position is well suited for someone with a strong background in auditory perception, neuroscience, or speech communication with an interest and experience in researching and implementing powerful and novel techniques in auditory attention. In this position you will jump in to solve novel problems, partnering with interdisciplinary teams, and employing vision and creativity to see beyond what traditional audio devices are capable of and take full advantage of what AR/VR has to offer in terms of enabling and enhancing communication. The role includes programming/coding to make workable MATLAB and Python real-time demonstrations of new concepts.


Currently has, or is in the process of obtaining a PhD in Experimental Psychology, Neuroscience, Acoustics, Computer Science, or a related field.

2+ years experience with data analysis, especially behavioral monitoring.

2+ years experience with scientific programming languages such as MATLAB, Python (PyTorch), C++, or similar.

Experience constructing audio-domain proof-of-concept and system performance evaluations.

Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.


Plan and execute a research roadmap focused on next generation auditory attention inference algorithms, source selection methods, techniques and systems using AR/VR technology.

Lead basic and applied research projects from concept to proof of experience.

Research and develop novel algorithms and techniques, measure performance, carry out analysis.

Collaborate closely with both the research and product teams to develop, test, and deploy new technologies.

Research and develop novel algorithms and techniques, measure performance, carry out analysis.

Closely collaborate with the interdisciplinary audio team, providing creative solutions to difficult problems.

Mentor graduate student interns and collaborate with external academic groups to advance our research goals.

Additional Requirements(额外要求)

Proven track record of innovation as demonstrated by products shipped, publications and/or patents.

Expertise in audio signal processing, machine learning, and/or auditory perception.

A background in motion tracking, eye tracking, behavioral monitoring and signal analysis.

Foundation in classical statistics and/or machine learning approaches.

Experience with acoustic systems.