Overview
Microsoft AI is looking for a Member of Technical Staff – Full Stack Software Engineer to help build the next wave of capabilities of our personalized AI assistant, Copilot. At Microsoft AI we believe in pushing the boundaries to create outstanding products and services. Our mission is to innovate and excel in AI so you can be more productive and efficient in everything you do.

In this role, you would be working with all the four stages of our evaluation platform: Data sampling, AI data collection and processing, data analysis/evaluation, and dashboarding. You will take on multiple engineering roles and work across the full stack, including database backend, middle-tier services, front-end browser automation, statistical analysis, and creating consumable dashboards. Your role will also involve prompt engineering and extensive use of AI tools.

This position offers the opportunity to work with a broad range of technologies and provides numerous opportunities across various surfaces such as desktop, web, and mobile. Collaboration with other teams within Microsoft AI will be a key part of your role. Our platform enables teams to assess the relevance and accuracy of Copilot, measure its performance, conciseness, trustworthiness, and visual appeal. It also supports automated testing, UX studies, and ad rendering for monetization. Envision performing these scenarios with voice input on web and mobile apps for iOS and Android. The possibilities are limitless.

Our newly formed organization, Microsoft AI, is dedicated to advancing Copilot and other consumer AI products and research. The team oversees Copilot, Bing, Edge, and generative AI research. Join us in shaping the future of personal computing powered by AI.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying for this Redmond, WA position, you are required to be local to the Seattle area and in office 3 days a week.

Responsibilities
Expertise in experimentation methodologies, including data sampling, measurement techniques, evaluation design, and data analysis.
Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
Proficiency in browser automation and web architecture.
Designing pipeline architecture to ensure rapid iteration and scalability.
Conducting post-analysis of labeled data and developing dashboards to visualize insights.
Collaborating closely with the product team to enhance quality and address gaps.
Embody our Culture and Values.

Qualifications

Required Qualifications:
Bachelor’s Degree in Computer Science or related technical field AND 4+ years of professional experience in the following: .NET, C#, HTML, CSS, JavaScript
2 years of experience with Azure SQL, Azure Storage
2 plus years of experience with browser automation tools like Selenium, Playwright or Puppeteer
Development & Debugging with Visual Studio 2019 or above

Preferred Qualifications:
ASP.NET, REST, Python, jQuery, JSX, React
Familiarity with mobile automation tools like Appium
Familiarity with LLMs and AI ChatBots
Prompt Engineering
Azure DevOps, GIT
Azure Open AI, Azure Foundry
Experience in leading technical projects and supporting architectural decisions with data.

Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $117,200 – $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 – $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications and processes offers for these roles on an ongoing basis.