Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Will BarlowTwins overfit on the training data? #38

Open
cucutone opened this issue Nov 26, 2021 · 0 comments
Open

Will BarlowTwins overfit on the training data? #38

cucutone opened this issue Nov 26, 2021 · 0 comments

Comments

@cucutone
Copy link

Hi, team members of BarlowTwins. I have a question about the framework of this algorithm.
When the output of projection layers grows, the total trainable parameters grow hugely. Does any overfitting situation occur?
Also, in the paper, why the results of transfer learning is not so good compared to supervised transfer learning? Could it be the reason that BarlowTwins may over focus on the features of training data?

Look forward to your reply, thank you.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant