Exploring the New Developer Preview of DirectML Support for NPU Acceleration on Windows 11 Devices with Intel® Core™ Ultra Processors

Posted by

Windows has launched a developer preview of DirectML support for Neural Processor Unit (NPU) acceleration. This update, which is compatible with new Windows 11 devices with Intel® Core™ Ultra processors, was developed in partnership with Samsung and Intel®. It offers support for a subset of machine learning models optimized for NPU acceleration.

DirectML Unveils NPU Support in Developer Preview

Windows has rolled out a developer preview of DirectML support for Intel® AI boost. This comes with the release of DirectML 1.13.1 and the ONNX Runtime 1.17. The preview introduces Neural Processor Unit (NPU) acceleration in DirectML, the machine learning platform API for Windows.

New Features in the Developer Preview

The developer preview supports a subset of models on new Windows 11 devices with Intel® Core™ Ultra processors with Intel® AI boost. This release was developed using open source models and in close partnership with Samsung.

“NPUs are emerging as a critical resource for broadly delivering efficient machine learning experiences to users, and Windows DirectML is one of the most efficient ways for Samsung’s developers to make those experiences for Windows,” said Hwang-Yoon Shim, VP and Head of New Computing H/W R&D Group at Samsung Electronics.

What is DirectML?

DirectML is a low-level API that provides a common abstraction layer for hardware vendors to expose their machine learning accelerators. It works with any DirectX 12-compatible device including GPUs and now NPUs.

Intel® Core™ Ultra Processors and Intel® AI Boost

Support for Intel® Core™ Ultra processors with Intel® AI Boost was developed in close collaboration with Intel®. The developer preview targets the NPU on new Intel® Core™ Ultra devices and runs a subset of machine learning models optimized for NPU acceleration.

“We are excited to enable our developer community to harness the power of the industry’s first NPU with DirectML support on Intel® Core™ Ultra processors! These exciting AI features and capabilities are only possible thanks for our deep partnership with Microsoft’s Windows AI team, and we’re looking forward to continuing this partnership and realizing many more exciting AI experiences!”, said Michael Langan, Senior Director of Engineering & General Manager NPU, Intel®.

Getting Started with NPU Support in DirectML

To use NPU support in DirectML, you need a Windows 11 device with an Intel® Core™ Ultra processor with Intel® AI boost, the DirectML 1.31.1 NuGet package, ONNX Runtime 1.17, and the latest NPU driver from Intel®.

Limitations of the Developer Preview

This developer preview is an early release that is intended to give you a glimpse of the future of DirectML with NPU support. It is only available for Intel® Core™ Ultra processers with Intel® AI Boost at this time and is currently only compatible with a subset of machine learning models that have been targeted for support.

  • DirectML now supports NPU acceleration in its developer preview.
  • The update is compatible with new Windows 11 devices with Intel® Core™ Ultra processors.
  • It was developed using open-source models in partnership with Samsung and Intel®.
  • Supports a subset of machine learning models optimized for NPU acceleration.
  • DirectML is a low-level API that provides a common abstraction layer for hardware vendors to expose their machine learning accelerators.
  • From the Windows Blog



    Related Posts
    Unlock New Possibilities with Windows Server Devices in Intune!

      Windows Server Devices Now Recognized as a New OS in Intune Microsoft has announced that Windows Server devices are Read more

    Unlock the Power of the Platform: Your Guide to Power Platform at Microsoft Ignite 2022

    Microsoft Power Platform is leading the way in AI-generated low-code app development. With the help of AI, users can quickly Read more

    Unlock the Power of Microsoft Intune with the 2210 October Edition!

    Microsoft Intune is an enterprise mobility management platform that helps organizations manage mobile devices, applications, and data. The October edition Read more

    Unlock the Power of Intune 2.211: What’s New for November!

    Microsoft Intune has released its November edition, featuring new updates to help IT admins better manage their organization’s mobile devices. Read more