Code

OLMO + RL#424

Code

Closed

vwxyzjn wants to merge 62 commits intomainallenai/open-instruct:mainfrom rlolmoallenai/open-instruct:rlolmoCopy head branch name to clipboard

+4,274-586

Commits

Commits on Sep 5, 2024

• init

  natolambert

  committed
  65aaaec

  Copy full SHA for 65aaaec

• up

  natolambert

  committed
  7da49a9

  Copy full SHA for 7da49a9

Commits on Sep 9, 2024

• branch dockerfile

  natolambert

  committed
  d929a89

  Copy full SHA for d929a89

• update

  natolambert

  committed
  6ef706c

  Copy full SHA for 6ef706c

• debugging and minor fixes

  natolambert

  committed
  a4797fb

  Copy full SHA for a4797fb

• nit and style

  natolambert

  committed
  56d6d86

  Copy full SHA for 56d6d86

• fixes

  natolambert

  committed
  50500ea

  Copy full SHA for 50500ea

• add weka mounting

  natolambert

  committed
  5eb61cc

  Copy full SHA for 5eb61cc

Commits on Sep 10, 2024

• up

  natolambert

  committed
  b134410

  Copy full SHA for b134410

• add hardcode flash_attn

  natolambert

  committed
  d007da0

  Copy full SHA for d007da0

• tweaks

  natolambert

  committed
  5d82ea2

  Copy full SHA for 5d82ea2

• making it work nicely

  natolambert

  committed
  11397bf

  Copy full SHA for 11397bf

Commits on Sep 11, 2024

• clean

  natolambert

  committed
  ee5c7d2

  Copy full SHA for ee5c7d2

• clean

  natolambert

  committed
  fd16aee

  Copy full SHA for fd16aee

• clean

  natolambert

  committed
  fa447f8

  Copy full SHA for fa447f8

• up

  natolambert

  committed
  e02e985

  Copy full SHA for e02e985

• no longer install from branch

  natolambert

  committed
  a0a32bf

  Copy full SHA for a0a32bf

Commits on Sep 16, 2024

• Merge branch 'main' into olmo_again

  natolambert

  committed
  eed8e4f

  Copy full SHA for eed8e4f

• fixes

  natolambert

  committed
  503e61e

  Copy full SHA for 503e61e

Commits on Sep 21, 2024

• Merge branch 'main' of https://github.com/allenai/open-instruct into olmo_again

  natolambert

  committed
  ec745b0

  Copy full SHA for ec745b0

Commits on Sep 24, 2024

• dpo config

  natolambert

  committed
  9827264

  Copy full SHA for 9827264

• temp olmo changes

  natolambert

  committed
  b175717

  Copy full SHA for b175717

Commits on Oct 1, 2024

• first pass

  hamishivi

  committed
  b444e80

  Copy full SHA for b444e80

Commits on Oct 2, 2024

• fix spelling, ground truth stuff

  

  Hamish Ivison

  committed
  f0569a3

  Copy full SHA for f0569a3

• fix misspelling

  

  Hamish Ivison

  committed
  8e0f517

  Copy full SHA for 8e0f517

Commits on Oct 4, 2024

• count verifieds and intermediate saving

  

  Hamish Ivison

  committed
  6eebf7f

  Copy full SHA for 6eebf7f

Commits on Oct 7, 2024

• save intermediate steps

  

  Hamish Ivison

  committed
  f9a0b3c

  Copy full SHA for f9a0b3c

Commits on Oct 8, 2024

• small fix to logging

  

  Hamish Ivison

  committed
  bad1933

  Copy full SHA for bad1933

Commits on Oct 9, 2024

• fix bug for forward rollout batching

  

  Hamish Ivison

  committed
  028315d

  Copy full SHA for 028315d

Commits on Oct 12, 2024

• support gsm8k and math, more flexibility in future

  

  Hamish Ivison

  committed
  faa7dc0

  Copy full SHA for faa7dc0

Commits on Oct 16, 2024

• add costas plo thing

  

  Hamish Ivison

  committed
  5970243

  Copy full SHA for 5970243

Commits on Oct 21, 2024

• add numina math

  

  Hamish Ivison

  committed
  f8fb8eb

  Copy full SHA for f8fb8eb

Commits on Oct 23, 2024

• remove plo, add value model rand init, first stab at rephrase model loading

  

  Hamish Ivison

  committed
  eda4849

  Copy full SHA for eda4849

• math strict verify

  

  Hamish Ivison

  committed
  b709f37

  Copy full SHA for b709f37

• Merge branch 'main' into verifiable-rewards

  

  Hamish Ivison

  committed
  a328946

  Copy full SHA for a328946

Commits on Oct 24, 2024

• ifeval code

  

  Hamish Ivison

  committed
  51f0b2a

  Copy full SHA for 51f0b2a

• ifeval debug

  

  Hamish Ivison

  committed
  79ec960

  Copy full SHA for 79ec960

• incorporate val fixes

  

  Hamish Ivison

  committed
  b1b47bf

  Copy full SHA for b1b47bf

• data fixed, remove skips

  

  Hamish Ivison

  committed
  d61038e

  Copy full SHA for d61038e

Commits on Oct 29, 2024

• Prototype ppo + ray (#390)

  Show description for 77f619d
  vwxyzjn

  authored
  77f619d

  Copy full SHA for 77f619d

• Merge branch 'main' into verifiable-rewards

  hamishivi

  committed
  b9de634

  Copy full SHA for b9de634

Commits on Oct 30, 2024

• add weka save override

  hamishivi

  committed
  f6a2b75

  Copy full SHA for f6a2b75

• add multinode ray file

  hamishivi

  committed
  b59659a

  Copy full SHA for b59659a

Commits on Oct 31, 2024

• lint and fix

  hamishivi

  committed
  36a2ed4

  Copy full SHA for 36a2ed4

Commits on Nov 1, 2024

• first stab at flan

  hamishivi

  committed
  527c51f

  Copy full SHA for 527c51f

Commits on Nov 4, 2024

• Merge branch 'main' into olmo_again

  Show description for a5ed1c1
  nouhadziri

  committed
  a5ed1c1

  Copy full SHA for a5ed1c1

• add olmo training

  nouhadziri

  committed
  281e28e

  Copy full SHA for 281e28e

• fix dir in config

  nouhadziri

  committed
  e8ddd56

  Copy full SHA for e8ddd56

• rollback my changes

  nouhadziri

  committed
  abd25bf

  Copy full SHA for abd25bf

Commits on Nov 5, 2024

• eval on intermediate checkpoints (#414)

  vwxyzjn

  authored
  f037460

  Copy full SHA for f037460

• Merge branch 'main' into verifiable-rewards

  hamishivi

  committed
  ed18615

  Copy full SHA for ed18615

• quick change

  vwxyzjn

  committed
  63a4449

  Copy full SHA for 63a4449

Commits on Nov 8, 2024

• Merge branch 'olmo_again' into rlolmo

  vwxyzjn

  committed
  3cfc9e2

  Copy full SHA for 3cfc9e2

• update OLMo code

  vwxyzjn

  committed
  ebdf456

  Copy full SHA for ebdf456

Commits on Nov 11, 2024

• push changes

  vwxyzjn

  committed
  3422229

  Copy full SHA for 3422229

Commits on Nov 15, 2024

• push changes

  vwxyzjn

  committed
  7905e63

  Copy full SHA for 7905e63

• Merge branch 'main' into rlolmo

  vwxyzjn

  committed
  918b701

  Copy full SHA for 918b701

Commits on Nov 23, 2024

• Merge branch 'main' into rlolmo

  vwxyzjn

  committed
  4d5c77a

  Copy full SHA for 4d5c77a

• quick change

  vwxyzjn

  committed
  e857e36

  Copy full SHA for e857e36

Commits on Nov 26, 2024

• push

  vwxyzjn

  committed
  0bebd50

  Copy full SHA for 0bebd50

Commits on Jan 8, 2025

• push changes

  vwxyzjn

  committed
  b452f92

  Copy full SHA for b452f92

• push changes

  vwxyzjn

  committed
  f732a73

  Copy full SHA for f732a73