Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Has the EWC of the paper been fully implemented? #2

Open
wangxiaodong1021 opened this issue Apr 7, 2017 · 1 comment
Open

Has the EWC of the paper been fully implemented? #2

wangxiaodong1021 opened this issue Apr 7, 2017 · 1 comment

Comments

@wangxiaodong1021
Copy link

I am glad to see the implementation of the work of EWC, but I feel trouble with you to achieve the EWC.
Why is the call to tf.nn.l2_loss when calculating EWC?

I was wondering if this was temporary replacement of EWC with L2 regularization because I did not see where to calculate the Fisher information matrix.

@wangxiaodong1021
Copy link
Author

wangxiaodong1021 commented Apr 11, 2017

All right, I just know that the Fisher is square(grad). But, in the paper, the EWC function is defined as λ/2*sum(F(θ-θA*)^2). In this code, EWC is implemented by λ/2*sum((F*(θ-θA*))^2). I'm not sure if I understand it is reasonable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant