How can I connect Databricks Community Edition cluster from PyCharm

2
votes

I want to work on some small exercise projects, I wish to use databricks cluster. Can this be done. I am hoping there is some way to connect databricks cluster through databricks-connect utility. Just need some steps. Thanks in advance.

3
apache-sparkpysparkdatabricksdatabricks-connectdatabricks-community-edition

3 Answers

2
votes

You might have already known this by now but adding this for new users.

Community Edition doesn't support databricks-connect functionality. It's only available for the enterprise version. This is the reason there is a no token generation available for community edition.

0
votes

The feature you aer looking for is called "databricks connect". You can configure several EDIs (e.g. Pycharm) to connect live to your Cluster on databricks community as well as Azure and AWS.

If you can understand German by any chance, this youtube video might help you. (Shows the full installation process for windows 10).

https://www.youtube.com/watch?v=VTfRh_RFzOs&t=3s

-1
votes

This article "Azure Databricks from PyCharm IDE", describes how to connect Databricks cluster from PyCharm IDE.

Hope this helps. Do let us know if you have any queries.