Code

use TextEncoder in coca encode_image#321

Code

Merged

rom1504 merged 25 commits intomlfoundations:cocamlfoundations/open_clip:cocafrom gpucce:encode_in_encodergpucce/open_clip:encode_in_encoderCopy head branch name to clipboardJan 6, 2023

+306-246

Commits

Commits on Dec 24, 2022

• use self.text in encode image

  

  gpucce

  committed
  0cb805c

  Copy full SHA for 0cb805c

• unused var

  

  gpucce

  committed
  59d7db9

  Copy full SHA for 59d7db9

Commits on Dec 25, 2022

• rever aAtention and CustoResidualAttentionBlock

  

  gpucce

  committed
  1c8592a

  Copy full SHA for 1c8592a

• remove whiteline

  

  gpucce

  committed
  7552db8

  Copy full SHA for 7552db8

• add dict output

  

  gpucce

  committed
  42deabd

  Copy full SHA for 42deabd

• bintegrate self.text attributes

  

  gpucce

  committed
  2d12297

  Copy full SHA for 2d12297

Commits on Dec 27, 2022

• HF compatibility

  

  gpucce

  committed
  9565e28

  Copy full SHA for 9565e28

• better config and minor fixes

  

  gpucce

  committed
  82ae3e2

  Copy full SHA for 82ae3e2

• clean

  

  gpucce

  committed
  0e46a01

  Copy full SHA for 0e46a01

Commits on Dec 29, 2022

• remove eembed_cls option from HF

  

  gpucce

  committed
  79cdc23

  Copy full SHA for 79cdc23

• use cls_token_position

  

  gpucce

  committed
  a5fd991

  Copy full SHA for a5fd991

• fix cls masking

  

  gpucce

  committed
  5acbee5

  Copy full SHA for 5acbee5

• resize labels

  

  gpucce

  committed
  93e7d93

  Copy full SHA for 93e7d93

• text -> self.text

  

  gpucce

  committed
  28ef905

  Copy full SHA for 28ef905

• split loss logging

  

  gpucce

  committed
  650877d

  Copy full SHA for 650877d

• add total loss

  iejMac

  committed
  6cfef50

  Copy full SHA for 6cfef50

• minor logs formatting

  

  gpucce

  committed
  7f2f7df

  Copy full SHA for 7f2f7df

Commits on Jan 4, 2023

• fix generate

  gpucce

  committed
  b621d09

  Copy full SHA for b621d09

• simpler logic

  gpucce

  committed
  b29c40a

  Copy full SHA for b29c40a

• disentangle proj for HF too

  gpucce

  committed
  8eb5400

  Copy full SHA for 8eb5400

• adjust config

  gpucce

  committed
  cd8212d

  Copy full SHA for cd8212d

Commits on Jan 5, 2023

• only norm cls

  gpucce

  committed
  963e051

  Copy full SHA for 963e051

• move attn_pool to VisionTransformer

  gpucce

  committed
  a06f1e5

  Copy full SHA for a06f1e5

• adjust coca_base config

  gpucce

  committed
  400aa5d

  Copy full SHA for 400aa5d

• fix grad checkpointing in MultimodalTransformer

  iejMac

  committed
  ba92b79

  Copy full SHA for ba92b79