Microsoft AR/VR Job | Research Intern – Generative AI for Interactive, Reality-Aware Computing Systems

Job(岗位): Research Intern – Generative AI for Interactive, Reality-Aware Computing Systems

Type(岗位类型): Research, Applied, & Data Sciences

Citys(岗位城市): Redmond/United States

Date(发布日期): 2023-10-31


Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

This position is for a research internship with the EPIC (Extended Perception, Interaction & Cognition) research group in Microsoft Research’s Redmond Lab. As part of the Transcendence project, the internship is focused on creating new interactive systems that leverage the power of generative AI techniques such as GPT and stable diffusion, deep learning models for vision and graphics, and conventional graphics and vision techniques. Of particular interest is the use of these techniques in combination with the real, physical world to create “blended realities”: interactive experiences that combine aspects of the real world and the new virtual worlds enabled by generative AI.

Sought-after skills and topics of interest for this internship include (but are not limited to):

  • Generative AI: LLMs, stable diffusion, ControlNet, and related technologies for interactive applications
  • Multimodal AI: object recognition; monocular depth estimation; GPT-V and related approaches; incorporating non-linguistic sensing in GPT; chain-of-thought reasoning
  • Future rendering: neural radiance fields; Gaussian splatting
  • Mixed reality: virtual, augmented, and mixed reality (VR / AR / MR); spatial sensing, projection, and interaction; blending physical and virtual spaces; productivity in mixed reality; collaborative virtual and hybrid spaces
  • Technical HCI & systems: hands-on builders of interesting HCI systems, techniques, and toolkits, especially when leveraging generative AI and coupled with skills for qualitative analyses and ethnographic methods, experimental analysis, design sketching, and/or design as a discipline of choice
  • Model development and training: design, training of novel AI models and methods; refinement or customization of existing models

We value your ideas and unique viewpoints on these topics, as well, and hope that our partnership and collaboration will shape initial directions into exciting, ambitious, and impactful research contributions that only you could have crafted.

The EPIC group conducts fundamental research that innovates at the nexus of hardware, software, and human potential. We are an interdisciplinary group of researchers, engineers, scientists, and designers at Microsoft Research who study Human-Computer Interaction (HCI) through prototyping, system-building, design sketching, and observational study of human behavior. You can learn more about the EPIC’s research agenda, publications, videos, and team members at EPIC – Microsoft Research. You can learn more about Transcendence at Transcendence – Microsoft Research: Overview.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.


Required Qualifications

  • Accepted or currently enrolled in a PhD program in Computer Science or related STEM field.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications above, you’ll need to submit a minimum of two reference letters for this position. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

Preferred Qualifications

  • At least 1 year experience conducting original research in (or closely related to) Human-Computer Interaction, and further be able to document their research contributions with publicly available resources (e.g. by linking to papers, pre-prints, videos, demonstrations, repositories, articles, press coverage, or research proposals in your submitted CV).

The base pay range for this internship is USD $6,290 – $12,170 per month. There is a different range applicable to specific work locations within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,060 – $13,240 per month.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.


Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, interns learn, collaborate, and network for life. Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, students are paired with mentors and expected to collaborate with other interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.