Code

Activation Ordering Strategies#121

Code

Merged

kylesayrs merged 80 commits intomainvllm-project/llm-compressor:mainfrom kylesayrs/actorder_static_groupvllm-project/llm-compressor:kylesayrs/actorder_static_groupCopy head branch name to clipboardSep 3, 2024

Commits

Commits on Aug 16, 2024

• actorder

  

  horheynm

  authored and

  kylesayrs

  committed
  012138a

  Copy full SHA for 012138a

• g_idx fix

  

  horheynm

  authored and

  kylesayrs

  committed
  f88c84e

  Copy full SHA for f88c84e

• fix

  

  horheynm

  authored and

  kylesayrs

  committed
  3211fe1

  Copy full SHA for 3211fe1

• lint

  

  horheynm

  authored and

  kylesayrs

  committed
  bbbf564

  Copy full SHA for bbbf564

• propagagte g_idx with perm

  

  horheynm

  authored and

  kylesayrs

  committed
  8d29f0d

  Copy full SHA for 8d29f0d

• scratch

  

  horheynm

  authored and

  kylesayrs

  committed
  89224e9

  Copy full SHA for 89224e9

• GPTQ - move calibration of quantiztion params to after hessian calibration

  

  Benjamin

  authored and

  kylesayrs

  committed
  cb8446d

  Copy full SHA for cb8446d

• no recompute

  

  horheynm

  authored and

  kylesayrs

  committed
  d7029a0

  Copy full SHA for d7029a0

• clean up

  

  horheynm

  authored and

  kylesayrs

  committed
  eeff533

  Copy full SHA for eeff533

• remvoe unwanted code

  

  horheynm

  authored and

  kylesayrs

  committed
  842b150

  Copy full SHA for 842b150

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  240c39d

  Copy full SHA for 240c39d

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  820d08a

  Copy full SHA for 820d08a

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  564845e

  Copy full SHA for 564845e

• mimic gptq

  

  horheynm

  authored and

  kylesayrs

  committed
  6f54737

  Copy full SHA for 6f54737

• permutation seems to be working

  kylesayrs

  committed
  2cc99bb

  Copy full SHA for 2cc99bb

• WIP: fails on non-square weights

  kylesayrs

  committed
  6fe537d

  Copy full SHA for 6fe537d

• pass perm into quant params calculation

  kylesayrs

  committed
  6611073

  Copy full SHA for 6611073

• works on vllm and loading with identity permutation

  kylesayrs

  committed
  9077969

  Copy full SHA for 9077969

• WIP: working pytorch with actorder

  kylesayrs

  committed
  6a1565e

  Copy full SHA for 6a1565e

• able to inference with script and reload, needed to set

  kylesayrs

  committed
  1940df4

  Copy full SHA for 1940df4

• remove testing comments

  kylesayrs

  committed
  11beac1

  Copy full SHA for 11beac1

• remove scripts

  kylesayrs

  committed
  9456698

  Copy full SHA for 9456698

• remove dregs

  kylesayrs

  committed
  0c773e6

  Copy full SHA for 0c773e6

• merge actorder and group cases

  kylesayrs

  committed
  b6bebc2

  Copy full SHA for b6bebc2

• code structuring and cleanup

  kylesayrs

  committed
  3bde194

  Copy full SHA for 3bde194

• use refresh_layer_weight_quant_params

  kylesayrs

  committed
  758c495

  Copy full SHA for 758c495

• update_layer_weight_quant_params reuse

  kylesayrs

  committed
  85fb1ff

  Copy full SHA for 85fb1ff

• deep copy H to allow for future reuse

  kylesayrs

  committed
  5b52e9d

  Copy full SHA for 5b52e9d

• hoist group_size

  kylesayrs

  committed
  9e2cef9

  Copy full SHA for 9e2cef9

• remove footer note

  kylesayrs

  committed
  e725cc7

  Copy full SHA for e725cc7

• apply style

  kylesayrs

  committed
  2392b83

  Copy full SHA for 2392b83

• fix rebase dreggs

  kylesayrs

  committed
  a5a30e1

  Copy full SHA for a5a30e1

• remove extra line

  kylesayrs

  committed
  ca6fc6e

  Copy full SHA for ca6fc6e

• move lines for better grouping

  kylesayrs

  committed
  6f99634

  Copy full SHA for 6f99634

• move for better diff

  kylesayrs

  committed
  b726bd6

  Copy full SHA for b726bd6

• remove extra lines

  kylesayrs

  committed
  2002761

  Copy full SHA for 2002761

Commits on Aug 17, 2024

• use getattr to avoid pr dep

  kylesayrs

  committed
  0ef0c5b

  Copy full SHA for 0ef0c5b

• Revert "use getattr to avoid pr dep"

  Show description for 476aed0
  kylesayrs

  committed
  476aed0

  Copy full SHA for 476aed0

Commits on Aug 21, 2024

• add actorder to docstring

  kylesayrs

  committed
  ffb809c

  Copy full SHA for ffb809c

Commits on Aug 22, 2024

• Merge remote-tracking branch 'origin' into kylesayrs/activation-ordering

  kylesayrs

  committed
  edc02d4

  Copy full SHA for edc02d4

• do not clone hessian

  kylesayrs

  committed
  bc49946

  Copy full SHA for bc49946

• apply style

  kylesayrs

  committed
  99f2286

  Copy full SHA for 99f2286

• avoid unset g_idx parameter by observing directly

  kylesayrs

  committed
  48b36c2

  Copy full SHA for 48b36c2

• use update_layer_weight_quant_params

  kylesayrs

  committed
  9550f14

  Copy full SHA for 9550f14

Commits on Aug 23, 2024

• Merge remote-tracking branch 'origin/main' into kylesayrs/activation-ordering

  kylesayrs

  committed
  d22ff2e

  Copy full SHA for d22ff2e

Commits on Aug 25, 2024

• Merge branch 'main' into kylesayrs/activation-ordering

  kylesayrs

  committed
  72d919f

  Copy full SHA for 72d919f

• indent for when quantization_scheme is missing

  kylesayrs

  committed
  e4d37a6

  Copy full SHA for e4d37a6

• add actorder e2e test

  kylesayrs

  committed
  cdc8bcd

  Copy full SHA for cdc8bcd

Commits on Aug 27, 2024

• do not freeze if initialized from gptq

  kylesayrs

  committed
  1fe188b

  Copy full SHA for 1fe188b

• add get_attr_chain helper function

  kylesayrs

  committed
  b06a103

  Copy full SHA for b06a103

• cleanup and clarify logic

  kylesayrs

  committed
  f293efd

  Copy full SHA for f293efd

• apply style

  kylesayrs

  committed
  a99e0da

  Copy full SHA for a99e0da

• rename to getattr_chain, handle no default case

  kylesayrs

  committed
  bf915d4

  Copy full SHA for bf915d4

• out of place type conversion

  kylesayrs

  committed
  66ef96b

  Copy full SHA for 66ef96b

• Merge remote-tracking branch 'origin/gptq-cleanup' into kylesayrs/activation-ordering

  kylesayrs

  committed
  98aaf88

  Copy full SHA for 98aaf88

• account for extra case

  kylesayrs

  committed
  91c877a

  Copy full SHA for 91c877a

Commits on Aug 28, 2024

• remove freeze_quantization argument

  kylesayrs

  committed
  b711e14

  Copy full SHA for b711e14

• remove fake_quantization case, update debug message

  kylesayrs

  committed
  974dbc7

  Copy full SHA for 974dbc7

• remove todo

  kylesayrs

  committed
  094e429

  Copy full SHA for 094e429

• Merge remote-tracking branch 'origin/gptq-cleanup' into kylesayrs/activation-ordering

  kylesayrs

  committed
  582c179

  Copy full SHA for 582c179

• correct name

  kylesayrs

  committed
  febb741

  Copy full SHA for febb741

• wip

  kylesayrs

  committed
  c74bbbd

  Copy full SHA for c74bbbd

• unpermute in both cases

  kylesayrs

  committed
  1af4a04

  Copy full SHA for 1af4a04

Commits on Aug 30, 2024

• integrate with ct

  kylesayrs

  committed
  1fdfdd7

  Copy full SHA for 1fdfdd7

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  8a22e82

  Copy full SHA for 8a22e82

• resolve merge

  kylesayrs

  committed
  2d3cc54

  Copy full SHA for 2d3cc54

• fix import

  kylesayrs

  committed
  9bfeb9f

  Copy full SHA for 9bfeb9f

• pass args

  kylesayrs

  committed
  2976c7e

  Copy full SHA for 2976c7e

• write g_idx only for group activation ordering

  kylesayrs

  committed
  e8053dd

  Copy full SHA for e8053dd

• unpermute for weight option as well

  kylesayrs

  committed
  143ec4b

  Copy full SHA for 143ec4b

• rename and add tests

  kylesayrs

  committed
  bfa3ff6

  Copy full SHA for bfa3ff6

• comments

  kylesayrs

  committed
  3de429c

  Copy full SHA for 3de429c

Commits on Sep 1, 2024

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  acd44cf

  Copy full SHA for acd44cf

Commits on Sep 3, 2024

• Activation Ordering Tests (#135)

  kylesayrs

  authored
  2696f45

  Copy full SHA for 2696f45

• update enum name, apply style

  kylesayrs

  committed
  c6710f8

  Copy full SHA for c6710f8

• break out actordering

  kylesayrs

  committed
  c39d945

  Copy full SHA for c39d945

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  d03ba61

  Copy full SHA for d03ba61

• compute sparsity mask after permutation

  kylesayrs

  committed
  00f2fa0

  Copy full SHA for 00f2fa0

• use get_observer

  kylesayrs

  committed
  14559a9

  Copy full SHA for 14559a9

• Merge branch 'main' into kylesayrs/actorder_static_group

  kylesayrs

  authored
  f903305

  Copy full SHA for f903305