BN layer weights and biases are not updated

[kregmi]

Thanks for sharing this repo, great work!

I trained BYOL on my data and noticed that the weights and biases for BN layers are not updated on the saved model. I used resnet18 without pretrained weights resnet = models.resnet50(pretrained=False). After training for multiple epochs, the saved model has bn1.weight all equal to 1.0 and bn1.bias all equal to 0.0 .

Is this the expected behavior or am I missing something? Appreciate your response!

[chingisooinar]

Hi @kregmi , I am not maintaining this repo but I am also using this implementation. I trained BYOL and did not experience this issue. I am not sure why it happened to you. Are you sure you saved the network correctly?