Meta AR/VR Job | Research Scientist, Perceptual Audio and Machine Learning | Oculus
Job（岗位）: Research Scientist, Perceptual Audio and Machine Learning | Oculus
Type（岗位类型）: Engineering | Hardware
Citys（岗位城市）: Sunnyvale, CA | Redmond, WA
Date（发布日期）: 2022-9-20
Summary（岗位介绍）
The perception of audio is at the center of our research, as it informs our work in spatial audio, speech intelligibility, defining audio quality, and many of the AR/VR systems. As a Research Scientist on the Advanced Audio Technologies Team at Facebook Reality Labs, you will be tackling the perceptual and psychoacoustic and ML challenges that define cutting-edge augmented & virtual reality, conducting research at the intersection of basic and applied science, as it informs our technology directions and identifies opportunities for revolutions in our audio quality metrics and audio experiences.
We are seeking a Research Scientist who is well versed in audio machine learning and auditory perception, and is excited about doing research that helps us inform AR/VR audio requirements and metrics towards new technologies.
With a focus on hands-on audio modeling and machine learning, we are seeking an individual with additional skill and knowledge in some of the following areas: speech intelligibility, audio perceptual evaluation, design of experiments, computational modeling of the audio system, audio quality metrics, intensity, distortion, timbre, dynamics and loudness perception, etc.
Qualifications（岗位要求）
Advanced Degree in machine learning, computer science, hearing science, acoustics, acoustic engineering, perceptual psychology, psychoacoustics, neuroscience, or a related field with an emphasis on perceptual modeling, audio machine learning psychoacoustics/physics, and/or metrics evaluating perceptual performance
2+ years of experience with machine learning (ML) or AI in audio (PyTorch, TensorFlow, Keras, Scikit-learn, Python, and associated audio processing toolboxes)
2+ years experience with MATLAB, Python, or similar program audio data analysis
Practical experience in setting up and managing a full ML modeling pipeline (GitHub, etc.)
Knowledge of the human auditory system and experience applying this model to novel situations and predict how the ear, brain, and body will respond
Interpersonal experience: cross-group and cross-culture collaboration
Description（岗位职责）
Responsible for modeling different aspects of audio quality using a wide range of data science modeling approaches as well as state-of-the-art ML based techniques
Collaborate with colleagues to structure efficient data collection across a wide range of speech and audio applications
Developing ML architectures to model audio datasets (identification, classification and regression models) using both CNN and deep learning approaches
Work with cross-functional partners in both research and product development to understand and prioritize modeling needs
Employ existing knowledge of human sensory encoding and audio quality metrics to help guide modeling in the most efficient and meaningful manner
Communicate and share the findings from modeling cross functionality for maximum benefit across the HW organization
Explore opportunities to develop and expand the role of ML based modeling in new technology and product development
Additional Requirements（额外要求）
MSc or PhD in machine learning, computer science, hearing science, acoustics, acoustic engineering, perceptual psychology, psychoacoustics, neuroscience, or a related field with an emphasis on perceptual modeling, audio machine learning psychoacoustics/physics, and/or metrics evaluating perceptual performance
Knowledge of perceptual audio evaluation techniques, standard audio quality metrics, and deriving new metrics for audio applications
Experience with MATLAB, R, Python, and/or C++
Experience with statistical analysis tools (e.g. SPSS, SAS, R, XLSTAT, and/or JMP)
Experience with user studies (psychoacoustics) and human factors
Familiarity with audio system and/or VR, MR, AR platforms
Experience in working on a team that ships product
Experience with research published in journals and international conference presentations or publications
