Research Intern - AI Serving Systems and Hardware - Microsoft Research

You'll be redirected to
the company's application page
Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.
We are seeking Research Interns to work where AI serving workloads meet the systems and hardware that run them. Large-model inference is limited by that hardware and by how well the serving stack uses it. Our team works across this boundary, from serving software and graphics processing unit (GPU) communication, through GPU clusters and their interconnects, down to chip architecture, to make AI serving faster, more reliable, and cheaper to build and run. Open problems range from keeping a large serving system running at predictable performance when GPUs, links, or software components fail to designing chips that keep pace with rapidly evolving workloads.
Research Interns will take on a research project in this space, shaped around their background and interests. Expected deliverables include working prototypes or simulators validated on real hardware, measurement studies, and paper submissions to top-tier venues.
Responsibilities
Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.
Additional Responsibilities
- Measure and characterize large language model (LLM) inference workloads on state-of-the-art GPU hardware, including how they behave when parts of the system fail or degrade.
- Build prototypes, simulators, or models that test new ideas in serving systems, fault tolerance, GPU communication, or AI hardware.
- Compare new approaches against existing methods.
- Document findings and prepare results for publication at top-tier venues.
- Present the work to technical audiences, both internally and externally.
Qualifications
Required Qualifications
- Currently enrolled in a Doctorate Degree program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.
Other Requirements
- Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
- In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.
Preferred Qualifications
- Research experience in computer systems, distributed systems, networking, or computer architecture and hardware design.
- Proficient programming skills in C/C++ and Python.
- Working knowledge of ML/AI/LLM concepts.
- Experience designing experiments and writing research papers.
Candidates should have depth of expertise in one or two of the following areas:
- Experience with GPU microarchitecture, performance modeling, or architectural simulators.
- Experience with CUDA, RDMA/verbs, or GPU collective communication libraries (e.g., NCCL, MSCCL++, DeepEP).
- Familiarity with LLM inference systems and serving stacks, including MoE models and expert parallelism.
- Experience measuring system performance at scale on real hardware.
- Prior work on fault tolerance or distributed ML systems.
- Publications at venues such as ISCA, MICRO, ASPLOS, HPCA, MLSys, OSDI, SOSP, NSDI, SIGCOMM, EuroSys, or ML venues such as NeurIPS and ICML.
- Ability to work both independently and collaboratively in a fast-moving research environment.
Intern - MSR- The typical base pay range for this role across Canada is CAD $9,150 - CAD $10,170 per month.
Find additional pay information here:https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Microsoft accepts applications and processes offers for these roles on an ongoing basis throughout the academic calendar (September - April).
Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Prep Tools
STUCK ON A QUESTION? PRACTICE IT
Practice Any Question
Get instant AI feedback
"How would you design a scalable system for Microsoft's use case?"
YOUR RESUME KNOWS THE QUESTIONS
AI Question Predictor
Based on Research Intern - AI Serving Systems and Hardware - Microsoft Research role
YOUR PERSONALIZED PREP ROADMAP
0-2 Research Intern - AI Serving Systems and Hardware - Microsoft Research
Interview Prep Plan