Keeping Datalab running

0
votes

So I tried running some long calculations in a Datalab notebook. It should have finished overnight. It did not.

What happened is Google shut down my datalab instance a bit after midnight, without stating any reason I can find. Why did they do so? It appear google shut it down on their end. The computer did fall asleep at one point, when it became unplugged. Maybe if the computer falls asleep, it still looks like google closed it from their end. This is completely unacceptable default behavior. Google shouldn't be assuming people have their computers running 24/7.

How can i prevent google from shutting down instances which are still working?

On a semi-related note, how can I keep notebooks running even if my computer doesn't maintain the connection? If my internet goes down, if the computer goes to sleep, etc, I want my cloud notebook to continue running. That's part of the point of the cloud afterall.

1
google-cloud-platformgoogle-cloud-datalab
I'd suggest you'd better use a VM instance and schedule a job via linux command tools (or if you prefer - ML Engine). Datalab is not the best place to run such computations. – irudyak

1 Answers

1
votes

See this: https://cloud.google.com/datalab/docs/concepts/auto-shutdown

After your computer is shutdown, your notebook's kernel will keep running on the VM (until it's auto-stopped, or you shut it down later), so if you were in the middle of a long-running notebook cell it should keep running to end. After the connection to the notebook is lost, the rest of the notebook won't run, and you won't be able to see the results of your commands inside the notebook.