The third-generation chip will run Microsoft’s AI inference workloads in production starting in 2027.

Microsoft announced Maia 300, its third-generation in-house AI chip, and positioned the processor as the primary AI inference system for Microsoft products and services. The company designed Maia 300 for long-context reasoning, latency-sensitive conversational experiences, and sustained multi-step agentic tasks. Microsoft says the chip will enter production in 2027.

Maia 300 follows Maia 200, which Microsoft announced in January and already runs production AI workloads across Microsoft Copilot, GitHub Copilot, Microsoft Foundry, and Microsoft’s own AI models. Scott Guthrie, executive vice president of Microsoft’s cloud group, says Maia 200 is the best performing AI infrastructure in Microsoft’s fleet.

For enterprise teams, Maia 300 targets lower cost and better efficiency for cloud AI inference. Microsoft says the chip can handle long-context reasoning, latency-sensitive conversational experiences, and multi-step agentic workloads. A 96-accelerator configuration delivers up to seven times the rack-scale token throughput of Maia 200.

Microsoft will scale its Azure Maia family to multi-gigawatt deployments starting in 2027. Maia 300 will serve as the primary AI inference system for Microsoft products and services, and Microsoft AI CEO Mustafa Suleyman says the company needs a platform it owns and co-designs with its models. The company also aims to catch up with Google DeepMind, OpenAI, and Anthropic through its own AI model work.

What matters

• Microsoft announced Maia 300 as its third-generation in-house AI chip for inference workloads.
• Microsoft expects the chip to deliver 40 percent more tokens per megawatt than leading GPU-based systems.
• Microsoft will scale its Maia family to multi-gigawatt Azure deployments starting in 2027.

Why it matters

Microsoft will scale its Maia family to multi-gigawatt Azure deployments starting in 2027.

This GenAI News article was prepared in original wording using reporting and materials published by The Verge. Source reference: https://www.theverge.com/news/1009465/microsoft-maia-300-chip-improvements-rollout.

Drafted by the GenAI News review pipeline.