I have created an Azure DataBricks cluster, which is in running state. But I cannot see shared, users and newly created notebooks under workspace. In fact, I can see a connecting... image on top left corner.
Please help.
0
votes
3 Answers
1
votes
For us the problem was Websocket traffic being blocked on our proxy servers by McAfee Web Gateway. The solution was to selctively allow Websocket traffic as described here:
Excerpt from that article:
CAUTION: Be careful in allowing a WebSockets connection through MWG, so you do not open a security hole inside your setup. We recommended you do not allow WebSockets in general, but allow only the destinations you really want to use WebSockets.
To import the required rule set: Log in to MWG. Select Policy, Rule Sets, Common Rules. Click Add and select Rule Set from Library. In the Overview section, expand Common Rules. Select WebSocket Handling and click OK. Place this rule set into your Common Rules set.
....
0
votes
To create a new notebook and attach it to a Spark cluster in Azure DataBricks, select New ➡ Notebook on the landing page in your DataBricks portal.
Give the notebook a unique name, and click Create.
Once the notebook has been created, select Detached in the upper left-hand corner, and then select the cluster you wish to connect to. If the circle next to cluster's name is grey, it must be restarted.
For full documentation on working with DataBricks on Azure, including a Quickstart for running a Spark SQL job, check out http://docs.microsoft.com.
