It adds a cluster manager, notebooks, dashboards, jobs, and integration with third-party apps, to the free open source Spark distribution. Databricks provides several sample notebooks for ML problems.

Microsoft and Databricks have actually worked on this integration since 2016, and this is making Databricks a first-party service on Azure.