Microsoft announces the preview release of Azure Synapse Runtime for Apache Spark 3.5, featuring upgrades from Apache Spark 3.5 and Delta Lake 3. Customers are encouraged to prepare for migration to Microsoft Fabric Spark to leverage enhanced performance and advanced features like Native Execution Engine and unified lakehouse security. Unique :
Azure Synapse Runtime for Apache Spark 3.5: What’s New?
Microsoft just dropped the preview of Azure Synapse Runtime for Apache Spark 3.5. This upgrade brings the latest Apache Spark 3.5 features and Delta Lake 3.2 enhancements to Azure Synapse users. If you’re running Spark workloads on Azure Synapse, this is the update you’ve been waiting for.
The new runtime includes all the fixes and improvements from Apache Spark 3.5, so expect smoother, faster, and more reliable data processing. Microsoft encourages you to check out the official release notes for a full rundown of changes. Also, don’t miss the migration guide from Spark 3.4 to 3.5 to avoid surprises in your jobs and notebooks.
Major Updates to Boost Your Spark Experience
While the preview lets you create Spark 3.5 runtimes in Azure Synapse, Microsoft is already nudging customers toward migrating to Microsoft Fabric Spark. Why? Fabric Spark packs exclusive innovations like the Native Execution Engine (NEE), which supercharges query performance without extra costs.
Other cool features in Microsoft Fabric Spark include starter pools that spin up Spark sessions in seconds, unified lakehouse security with Row-Level Security (RLS) and Column-Level Security (CLS), and the newly added Materialized Views. These upgrades make managing and querying big data more efficient and secure.
Why You Should Care About This Update
Upgrading to Azure Synapse Runtime for Apache Spark 3.5 means you get the latest Spark improvements right now. However, planning your move to Microsoft Fabric Spark is crucial to unlock next-level performance and security features.
“The Native Execution Engine (NEE) significantly enhances query performance at no additional cost.” – Microsoft
“Starter pools allow the creation of a Spark session within seconds, unified security in the lakehouse enables RLS and CLS.” – Microsoft
In short, this update is a stepping stone. It keeps your current Spark workloads fresh while preparing you for the future with Microsoft Fabric Spark. If you’re serious about big data analytics, now’s the time to explore these new runtimes and plan your migration strategy.
For more details, check out the official Azure Synapse Runtime for Apache Spark 3.5 documentation.
From the New blog articles in Microsoft Community Hub
Windows Server Devices Now Recognized as a New OS in Intune Microsoft has announced that Windows Server devices are Read more
Microsoft Power Platform is leading the way in AI-generated low-code app development. With the help of AI, users can quickly Read more
Microsoft Intune is an enterprise mobility management platform that helps organizations manage mobile devices, applications, and data. The October edition Read more
Microsoft Intune has released its November edition, featuring new updates to help IT admins better manage their organization’s mobile devices. Read more
