How Open OnDemand and Azure CycleCloud Workspace Enhance Secure HPC Access with Integrated VSCode and Azure NetApp Files

Discover how Open OnDemand integrates with Azure CycleCloud Workspace for Slurm to streamline HPC access. This setup leverages Microsoft Entra ID for secure authentication, supports Azure NetApp Files for shared storage, and includes a pre-configured VSCode for seamless web-based development on compute nodes. Unique :

Unlocking HPC Power: Open OnDemand Meets Azure CycleCloud Workspace for Slurm

If you’re deep into high-performance computing (HPC), the latest integration between Open OnDemand and Azure CycleCloud Workspace for Slurm is a game-changer. Open OnDemand, an open-source portal from the Ohio Supercomputer Center, now teams up with Azure CycleCloud to simplify HPC cluster management and access. This combo brings a sleek, web-based interface to your Slurm clusters, making HPC more accessible than ever.

What’s New?

The highlight here is the seamless deployment of Open OnDemand VMs using dedicated CycleCloud cluster templates and project scripts. Once set up, a local daemon automatically registers Slurm clusters by querying CycleCloud, streamlining cluster management. Plus, Microsoft Entra ID handles user authentication via OpenID Connect, enhancing security without the hassle of managing secrets.

“The application uses federated credentials, a secure way that eliminates the need to use secrets when requesting authentication tokens.”

Another cool feature: Visual Studio Code comes pre-configured on Open OnDemand. You can run VSCode in web mode directly on login or compute nodes, boosting productivity for developers and researchers alike.

Major Updates and Setup Essentials

Networking and Security

Direct connectivity to the Open OnDemand VM is mandatory. Since public IPs are disabled by default, you’ll need a VPN connection to access the web portal securely. Note that Azure Bastion tunneling isn’t supported here, so plan your network accordingly.

Shared File System

Open OnDemand requires a shared home directory with the Slurm cluster to map authenticated users properly. Azure NetApp Files is recommended for the /shared and /home directories. Avoid using temporary network shares for production; cluster termination can break Open OnDemand.

Microsoft Entra ID Application Setup

Due to technical limitations, you must manually register or configure a Microsoft Entra ID application for authentication. The process involves setting federated credentials and assigning a user-managed identity to the Open OnDemand VM. This setup ensures secure, secret-free token requests.

“Registration of an application during deployment using the marketplace UI is not possible due to technical limitations.”

Deployment Made Simple

You can deploy via the Azure Marketplace UI or use the az bicep CLI for more control. The Marketplace route guides you through selecting Azure NetApp Files, configuring networking (VPN or hub-and-spoke), and specifying Slurm login nodes. Remember to enter your user domain for Microsoft Entra ID and choose between existing or new Entra ID applications.

For the CLI enthusiasts, cloning the Azure CycleCloud Workspace for Slurm GitHub repo and using the UI Definition Sandbox provides a flexible deployment experience. The CLI approach also supports automatic Microsoft Entra ID app registration if your account has the right permissions.

Why It Matters

This integration dramatically lowers the barrier to HPC cluster access and management. By combining Open OnDemand’s user-friendly web portal with Azure CycleCloud’s powerful orchestration, HPC users gain a streamlined, secure, and productive environment. Whether you’re running complex simulations or data-heavy workloads, this setup saves time and reduces operational headaches.

In short, if you’re managing Slurm clusters on Azure, this integration is a must-try. It’s designed to make HPC feel less like rocket science and more like everyday work.

Open OnDemand offers a web-based portal for easy HPC resource access, enhanced by Azure CycleCloud’s deployment automation.

Microsoft Entra ID manages user authentication via OpenID Connect, ensuring secure and federated identity management.

Shared home directories between Slurm clusters and Open OnDemand VM use Azure NetApp Files or network file shares for consistency.

Deployment supports private IP networking with VPN access; Azure Bastion tunneling is not supported.

Users can run Visual Studio Code in web mode directly on login or compute nodes, improving remote development workflows.

From the New blog articles in Microsoft Community Hub