0.6.0

make attention numerically stable, as well as extra layernorms from n…

0.5.1

store context length of text transformer on root object

0.5.0

start using swish glu everywhere after success of PaLM paper

0.4.6

default projection hidden size for visual ssl to 4096

0.4.5

fix issue with simsiam mlp hidden size

0.4.4

store some image related hyperparameters, exposed for dalle2

0.4.3

store some dimensions for access by dalle2

0.4.2

start going bias-less due to PaLM

0.4.1

add ability to return early encodings of text and images, for dalle2

0.4.0

fix simsiam