Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Where is the codebook loss? #129

Open
waynchi opened this issue Jul 26, 2020 · 1 comment
Open

Where is the codebook loss? #129

waynchi opened this issue Jul 26, 2020 · 1 comment

Comments

@waynchi
Copy link

waynchi commented Jul 26, 2020

Hi! I'm going through the codebase trying to understand the various losses that you use. I can find the recons and commit losses, but I can't find the codebook loss anywhere. Could someone point me to where that would be?

Thanks!

@waynchi waynchi changed the title Codebook vs Commit Loss: Mislabeled? Where is the codebook loss? Jul 26, 2020
@MlWoo
Copy link

MlWoo commented Jul 27, 2020

@waynchi The paper explains it very clear. "To speed up training, the loss of codebook instead uses EMA up- dates over the codebook variables."

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants