Microsoft has unveiled Windows ML, a powerful runtime designed to enhance machine learning development on Windows. This innovative platform simplifies deployment and optimizes on-device model inference, enabling developers to create AI-driven applications across a diverse hardware landscape. With support from major silicon partners, Windows ML aims to streamline workflows and enhance performance, making it easier for developers to leverage advanced AI capabilities on Windows 1

Introducing Windows ML: A Game-Changer for Machine Learning on Windows
Microsoft has officially unveiled Windows ML, a groundbreaking runtime designed to enhance machine learning development on Windows. This public preview is set to revolutionize how developers create AI-infused applications.
What’s New?
Windows ML is optimized for on-device model inference, making it easier for developers to deploy AI applications. With advancements in client silicon and model miniaturization, running complex AI models locally is now a reality.
“Windows ML seamlessly integrates across CPUs, GPUs, and NPUs across AMD’s portfolio, empowering ISVs to deliver groundbreaking AI experiences.” — John Rayfield, Vice President of AI, AMD
Major Updates
This new framework supports a wide range of hardware, from entry-level laptops to high-end AI workstations. Developers can now leverage the best silicon for their specific workloads, whether it’s an NPU for low-power tasks, a GPU for high performance, or a CPU for flexibility.
Windows ML is built on the foundation of ONNX Runtime Engine (ORT), allowing seamless integration with existing models. This ensures that developers can utilize familiar APIs while optimizing model performance.
Key Features
- Simplified Deployment: No need for multiple builds targeting different silicon. Developers can register models directly on devices.
- Advanced Silicon Targeting: Optimize for low-power or high-performance scenarios, allowing for split processing between CPU, GPU, and NPU.
- Performance Boost: Expect up to 20% improvement compared to other model formats, thanks to optimizations like progressive memory mapping.
- Compatibility: Windows ML guarantees conformance and compatibility, ensuring ongoing improvements and accuracy.
“Intel’s partnership with Microsoft on Windows ML supercharges AI app development by tightly integrating high-performance workflows.” — Sudhir Tonse Udupa, Vice President, AI PC Software Engineering, Intel
What’s Important to Know?
The public preview of Windows ML is available on all Windows 11 machines. Developers can explore its capabilities and provide feedback. The AI Toolkit for VS Code will support model preparation, conversion, and optimization, simplifying the development process.
In conclusion, Windows ML is a significant leap forward in machine learning development on Windows. It empowers developers to create innovative AI applications more efficiently than ever before.
From the Windows Blog