Sagemaker Hyperparameter Tuning Job Mechanism

Question

Does anyone know what's the mechanism behind hyperparameter tuning job in AWS Sagemaker?

In specific, I am trying to do the following:

1. Bring my own container
2. Minimize cross entropy loss (this will be the objective metric of the tuner)

My question is when we define the hyper parameter in HyperParameterTuner class, does that get copied into /opt/ml/input/config/hyperparameters.json?

If so, should one adjust the training image so that it uses the hyper parameters from /opt/ml/input/config/hyperparameters.json?

Edit: I've looked into some sample HPO notebooks that AWS provides and they seem to confuse me more. Sometimes they'd use argparser to pass in the HPs. How is that passed into the training code?

Answer 1

If you bring your own container, you should consider pip installing SageMaker Training Toolkit. This will allow you to receive hyperparameters as command line arguments to your training script (to be processed with argparser). This will save you the need to Read and parse the /opt/ml/input/config/hyperparameters.json yourself.