set jupyterhub notebook_dir to s3 on emr 5.16

Question

is there a way to redirect the notebook-dir to s3 in the JSON configuration file of an EMR-Cluster befor start the cluster. I used the following classification: "jupyter-notebook-conf" and set the following option: c.NotebookApp.notebook_dir "s3://[bucket]/path"

That creates the config file: "/etc/jupyter/jupyter_notebook_config.py" with the given entry, but with no success.

Earlier I could use the option --notebook-dir when I installed the jupyterhub manually, but now I try to use the preinstalled jupyterhub service of the EMR-Cluster (see: Run Jupyter Notebook and JupyterHub on Amazon EMR)

Steven Steven · Accepted Answer · 2018-09-10T14:02:46

not supported on 5.16

5.17 allows this by adding this config classification

[
    {
        "Classification": "jupyter-s3-conf",
        "Properties": {
            "s3.persistence.enabled": "true",
            "s3.persistence.bucket": "MyJupyterBucket"
        }
    }
]

set jupyterhub notebook_dir to s3 on emr 5.16

1 Answers