There's probably something very obvious I'm missing or Sagemaker just doesn't support these kinds of extensions, but I've been trying to enable toc2 (Table of Contents) jupyter extension for my Sagemaker notebook via lifecycle configurations, but for whatever reason it still isn't showing up.
I built my script out combining a sample AWS script and a quick article on the usual ways of enabling extensions:
https://towardsdatascience.com/jupyter-notebook-extensions-517fa69d2231
#!/bin/bash
set -e
sudo -u ec2-user -i <<EOF
--Activate notebook environment
source activate JupyterSystemEnv
--Install extensions
pip install jupyter_contrib_nbextensions && jupyter contrib
nbextension install
jupyter nbextension enable toc2 --py --sys-prefix
source deactivate
EOF
Thanks!