How to reduce the verbosity of sagemaker training jobs?

Question

I am training a model with tqdm in the dataloader, the log prints every update in a seperate line that fills up the entire notebook. Is there a way to reduce the verbosity or remove the logs entirely from the jupyter cell similar to from IPython.display import clear_output clear_output(wait=True)?

Answer 1

usually the logging can be controlled using the API parameters and SageMaker doesn't usually add a lot of additional verbose. If you are using a sagemaker notebook instance to run your training you can very well use Ipython clear_output as the notebook is based on jupyter lab.