What is the difference between Base Learning rate in Nvidia Digits UI during training and Learning rate param(lr_pm) for each layer defined in the caffe .prototxt file. Finally which learning rate is used?
you mean lr_multi or lrn_param or both ?
– Milind Deore
lrn_param has nothing to do with learning rate: it stores paramters for "LRN" layer.
– Shai
1 Answers
0
votes
The learning rate for a particular layer is the global learning rate multiplied with the lr_mult of that specific layer.
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.OkRead more
lr_multiorlrn_paramor both ? – Milind Deorelrn_paramhas nothing to do with learning rate: it stores paramters for"LRN"layer. – Shai