Databricks Delta Lake + ADSL + Presto

Question

Databricks has just released a public preview of Delta Lake and Presto integration. I'm new to Azure, and the link has multiple mentions of EMR and Athena but lack Azure keywords. So I have to ask a stupid question:

Am I right that Presto integration is only for AWS since Azure doesn't have Presto PaaS?

P.S. Have Databricks any plans for Delta Lake and Synapse/Polybase integration in nearest future?

Answer 1

Delta Lake Presto integration is based on "symlinks" and they are supported in Presto since long. On Azure, you can conveniently provision Presto using

• Starburst Presto Kubernetes + Azure AKS (recommended)
• Starburst Presto for HDInsights, freely available in HDInsights Marketplace (more of a "legacy" option)
• there is also some Azure offering from Qubole and perhaps others

Bear in mind, however, that "symlinks"-based integration has certain limits. Here, at Starburst, we're working on native Delta Lake support, without need to create "symlinks".