Microsoft’s Making A Serious Commitment To Apache Spark
This week in San Francisco, thousands of people are gathering for Spark Summit, the Apache Spark developer conference. Attending the show this year, and also keynoting, is Microsoft, who is making a serious commitment to the platform to help power the company’s big data and analysis offerings.
Apache Spark is a general engine for large scale data processing that is used by more than a thousand organizations and that number will likely grow in the near future as Microsoft is announcing new support for the product.
- Spark for Azure HDInsight General Availability, previously announced as public preview, Spark for Azure HDInsight generally available today, and introducing a fully managed Spark service from Hortonworks that has been hardened for the enterprise
- R Server for HDInsight in the cloud powered by Spark, previously announced as public preview, R Server for HDInsight will be generally available this summer.
- R Server for Hadoop on-premises is now powered by Spark, R Server for Hadoop will support both Microsoft R and native Spark execution frameworks available in June.
- Power BI support for Spark Streaming, previously announced with Power BI General Availability, Spark support in Power BI is now expanded with new support for Spark Streaming scenarios.
Several years ago, announcements like this would have seen out of the ordinary for a company who has its own products that compete with Apache Spark. But, in the past couple of years, the company has been opening up its platforms to be more inclusive in the open source community and these types of announcements have become commonplace.
While it’s a bit too early to definitively say if being more open has improved or hindered its bottom line, early indications show that the general feelings toward the company are improving and Azure is growing at a significant rate.
More in Microsoft Azure
Microsoft Now Lets IT Admins Review & Remove Inactive Azure AD Users
May 27, 2022 | Rabia Noureen
Build 2022: Microsoft's Intelligent Data Platform Combines Data and Analytics
May 25, 2022 | Rabia Noureen
Microsoft Revises Restrictive Cloud Licensing Policies to Avoid EU Antitrust Probe
May 19, 2022 | Rabia Noureen
Microsoft's Azure AD Conditional Access Service Can Now Require Reauthentication
May 13, 2022 | Rabia Noureen
Microsoft Addresses Cross-Tenant Database Vulnerability in Azure PostgreSQL
Apr 29, 2022 | Rabia Noureen
Microsoft Simplifies IT Monitoring with New Azure Managed Grafana Service
Apr 19, 2022 | Rabia Noureen
Most popular on petri