Presented in Symbolic Discovery of Optimization Algorithms. It is more memory-efficient than Adam as it only keeps track of the momentum. Different from adaptive optimizers, its update has the same magnitude for each parameter calculated through the sign operation.
-
Notifications
You must be signed in to change notification settings - Fork 0
ocss884/google-Lion
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published