Fix a bug in optimizer's mix_lr/max_lr when args.override_opt_param_scheduler==True#1284

Open

lyuwen wants to merge 1 commit intoNVIDIA:mainfrom lyuwen:fix-optimizer-lr-override

+10

Commits on Nov 12, 2024

Fix a bug when --override-opt_param_scheduler is used, the learning rates settings in optimizer.param_groups still uses the old settings from the checkpoint. This results in wrong learning rate set…
lyuwen
committed