Microsoft’s VS Code team moved to weekly releases after 10 years of monthly — and credits AI for making it possible

by Chief Editor

The Rise of the AI-Powered Product Manager: How Microsoft is Redefining Software Development

The traditional boundaries between product management and engineering are dissolving, thanks to the rapid integration of artificial intelligence into the software development lifecycle. At Microsoft, a quiet revolution is underway, spearheaded by Pierce Boggan, Product Lead for VS Code and GitHub Copilot, and his team. They’re pioneering a workflow where product managers (PMs) can directly prototype and evaluate features using AI agents, fundamentally altering how software is built.

From Specs to PRs: The Prototype-First Approach

For years, product managers have relied on detailed specifications (PRDs) to communicate their vision to engineers. Boggan’s team is shifting that paradigm. The new approach treats a prototype – embodied as a pull request (PR) – as the primary spec. Instead of writing extensive documentation, PMs now build directly within VS Code, leveraging GitHub Copilot to translate ideas into functional code.

“The spec sharpens as I use the product, not just write about it,” Boggan explains. A recent example involved a PR for forking conversations in Copilot Chat, built and refined in a single day with engineer feedback. This illustrates a move towards iterative development driven by direct experience, rather than theoretical planning.

Pro Tip: Focus on UI and interaction-level changes when starting with this approach. These areas benefit most from rapid prototyping and immediate feedback.

AI Tools Powering the Transformation

The VS Code team isn’t relying on a single AI tool, but rather a suite of integrated technologies. They adhere to the principle of “using VS Code to build VS Code,” extending this to AI-assisted workflows. Key components include:

  • VS Code & GitHub Copilot: The core development environment and AI pair programmer.
  • Work IQ: Used to summarize updates from calendars, emails, and Teams messages.
  • GitHub MCP: Fetches relevant context about product and engineering updates.
  • Custom Agents & Slash Commands: Built by engineers to automate tasks like commit summarization and issue grooming.
  • Copilot Code Review: A mandatory first pass for all PRs.
  • ‘Demonstrate’ Agent: Self-validates changes by launching VS Code, navigating features, and taking screenshots.

The team also employs internal benchmarks (vsc-bench) to evaluate different AI models, selecting the most appropriate one for specific tasks – faster models for commit summarization and more capable models for code generation.

Quantifying the Impact: Velocity, Cadence, and Quality

The adoption of AI isn’t just about changing workflows; it’s about measurable results. Microsoft has seen significant improvements in several key metrics:

  • Release Cadence: A shift from 10-year monthly releases to weekly releases.
  • Commit Velocity: An increase from 20-30 commits per fetch to over 100 per day.
  • PR Cycle Times: Compressed review and merge times.
  • Regression Rates: Despite increased velocity, the team is maintaining – and even improving – code quality, with fewer regressions reaching stable releases.

These improvements are attributed to the automation of previously manual tasks, such as triage, testing, and release note generation.

The Future of Roles: A Blurring of Lines

As AI becomes more deeply integrated, the roles of product managers and engineers are evolving. The distinction between “thinking about the product” and “building the product” is becoming increasingly blurred. Everyone is becoming a more full-stack contributor.

Boggan emphasizes the importance of “agent-ready codebases.” Engineering teams need to invest in clear documentation, robust testing, and well-defined ownership boundaries – not to restrict access, but to facilitate safe and effective collaboration with AI agents. The ability to create such codebases is becoming a critical meta-skill.

Did you know? The mechanical parts of software development – boilerplate code, routine issue triage – are increasingly being handled by AI agents, freeing up engineers to focus on more creative and strategic tasks.

FAQ

Q: What is an “agent-ready codebase”?
A: A codebase that is well-documented, thoroughly tested, and has clear ownership boundaries, making it easier for AI agents to understand and contribute to the project.

Q: Is AI replacing engineers?
A: No, AI is augmenting engineers, automating repetitive tasks and allowing them to focus on more complex problem-solving and creative work.

Q: What skills will be most valuable for developers in the future?
A: Taste, judgment, and the ability to evaluate user experience will become increasingly important as AI handles more of the technical aspects of development.

Q: What tools are being used to facilitate this change?
A: VS Code, GitHub Copilot, Work IQ, GitHub MCP, and custom-built agents and slash commands are all playing a role.

Seek to learn more about the future of AI in software development? Follow Pierce Boggan on X for the latest updates and insights.

You may also like

Leave a Comment