Code

Add coca trained (#307)#308

Code

Merged

rom1504 merged 34 commits intomainmlfoundations/open_clip:mainfrom cocamlfoundations/open_clip:cocaCopy head branch name to clipboardJan 29, 2023

+976-93

Commits

Commits on Dec 20, 2022

• Add coca trained (#307)

  Show description for 1b86601
  

  4 peopleauthored
  1b86601

  Copy full SHA for 1b86601

Commits on Dec 21, 2022

• Add coca to CI

  rom1504

  authored
  29fa332

  Copy full SHA for 29fa332

• Add coca to CI pr

  rom1504

  authored
  911c737

  Copy full SHA for 911c737

• simplify encode_iamge (#313)

  Show description for b4881bc
  

  gpucce

  and

  rom1504

  authored
  b4881bc

  Copy full SHA for b4881bc

• Add cls mask (#312)

  Show description for 50bc599
  

  3 peopleauthored
  50bc599

  Copy full SHA for 50bc599

Commits on Dec 22, 2022

• Ignore pad tokens in captioning loss (#316)

  Show description for 279e088
  

  gpucce

  and

  gpucce

  authored
  279e088

  Copy full SHA for 279e088

• add generate to coca model (#314)

  Show description for dee1ea5
  

  gpucce

  and

  gpucce

  authored
  dee1ea5

  Copy full SHA for dee1ea5

Commits on Jan 6, 2023

• use TextEncoder in coca encode_image (#321)

  Show description for 30a73d4
  

  3 peopleauthored
  30a73d4

  Copy full SHA for 30a73d4

• Merge branch 'main' into coca

  rom1504

  authored
  f616050

  Copy full SHA for f616050

Commits on Jan 9, 2023

• Get some basic PEP changes out of the way

  rwightman

  committed
  061482b

  Copy full SHA for 061482b

Commits on Jan 21, 2023

• Add tests bis (#355)

  Show description for d0bd09e
  gpucce

  authored
  d0bd09e

  Copy full SHA for d0bd09e

• Merge branch 'main' into coca

  rom1504

  authored
  ef80b7b

  Copy full SHA for ef80b7b

• train.py: fix is_clip when doing distributed (#364)

  iejMac

  authored
  2ab47b7

  Copy full SHA for 2ab47b7

Commits on Jan 22, 2023

• add README (#365)

  Show description for c0e5950
  iejMac

  authored
  c0e5950

  Copy full SHA for c0e5950

• Merge branch 'main' into coca

  rom1504

  authored
  9ab881e

  Copy full SHA for 9ab881e

• remove output_dict argument (#368)

  Show description for 3f5b0fb
  gpucce

  authored
  3f5b0fb

  Copy full SHA for 3f5b0fb

• do same thing for _encode_image (#366)

  Show description for de343fb
  iejMac

  authored
  de343fb

  Copy full SHA for de343fb

Commits on Jan 23, 2023

• CoCa/forward: remove unused output_dict param

  

  iejMac

  authored and

  rwightman

  committed
  88aa6ce

  Copy full SHA for 88aa6ce

Commits on Jan 24, 2023

• Revert "do same thing for _encode_image (#366)"

  Show description for 3b66f37
  

  gpucce

  authored and

  rwightman

  committed
  3b66f37

  Copy full SHA for 3b66f37

• refactor

  

  gpucce

  authored and

  rwightman

  committed
  cdb91dd

  Copy full SHA for cdb91dd

• white space

  

  gpucce

  authored and

  rwightman

  committed
  58eb5bd

  Copy full SHA for 58eb5bd

• remove extra layer norm

  

  gpucce

  authored and

  rwightman

  committed
  cbd66ed

  Copy full SHA for cbd66ed

• move to_logits into decoder

  

  gpucce

  authored and

  rwightman

  committed
  bf6ef3e

  Copy full SHA for bf6ef3e

• leave for later

  

  gpucce

  authored and

  rwightman

  committed
  03dfeab

  Copy full SHA for 03dfeab

Commits on Jan 25, 2023

• better torchscript

  

  gpucce

  authored and

  rwightman

  committed
  15d6223

  Copy full SHA for 15d6223

• annotate hf too

  

  gpucce

  authored and

  rwightman

  committed
  9beb0d4

  Copy full SHA for 9beb0d4

Commits on Jan 27, 2023

• Add CoCa-ViT-L/14 config (#379)

  iejMac

  authored
  fde2aee

  Copy full SHA for fde2aee

• Merge branch 'main' into coca

  rom1504

  authored
  24e454d

  Copy full SHA for 24e454d

Commits on Jan 28, 2023

• Remove dead LN code, refactor attn_pool conditional for more clarity, minor formatting tweaks

  rwightman

  committed
  f7c566b

  Copy full SHA for f7c566b

• latent_dim to embed_dim

  

  gpucce

  authored and

  rwightman

  committed
  9533575

  Copy full SHA for 9533575

• remove extra cfg

  

  gpucce

  authored and

  rwightman

  committed
  f5e0c5a

  Copy full SHA for f5e0c5a

• A bit more cleanup, keep context_length as context len, 'num_pos' to incl extra tokens. None type check for embed_cls instead of getattr

  rwightman

  committed
  1ba2ab6

  Copy full SHA for 1ba2ab6

Commits on Jan 29, 2023

• CoCa: add B/32 pretrained (#389)

  Show description for f0847fa
  iejMac

  authored
  f0847fa

  Copy full SHA for f0847fa

• remove coca from ci.yml

  rom1504

  authored
  ba081d3

  Copy full SHA for ba081d3