Code

Bdellabe/Rtuli awq modifier v3#1177

Code

Open

brian-dellabetta wants to merge 22 commits intomainvllm-project/llm-compressor:mainfrom bdellabe/awq-modifier-v3vllm-project/llm-compressor:bdellabe/awq-modifier-v3Copy head branch name to clipboard

Commits

Commits on Feb 18, 2025

• cherry picked files from stale PR #181 branch awq-feature-branch

  Show description for 98a5b73
  brian-dellabetta

  committed
  98a5b73

  Copy full SHA for 98a5b73

• updated to be compatible with latest, unit tests passing

  Show description for 2611966
  brian-dellabetta

  committed
  2611966

  Copy full SHA for 2611966

• switch to using HooksMixin api

  Show description for 88aeab8
  brian-dellabetta

  committed
  88aeab8

  Copy full SHA for 88aeab8

• pydantic serialization issue fix

  Show description for 2b74ccf
  brian-dellabetta

  committed
  2b74ccf

  Copy full SHA for 2b74ccf

Commits on Feb 19, 2025

• switch to accelerate with align_module_device

  Show description for cb5956e
  brian-dellabetta

  committed
  cb5956e

  Copy full SHA for cb5956e

• AWQ running but OOMs unless NUM_CALIBRATION_SAMPLES and MAX_SEQUENCE_LENGTH are very low

  Show description for 5cb055c
  brian-dellabetta

  committed
  5cb055c

  Copy full SHA for 5cb055c

Commits on Feb 20, 2025

• working with larger num_calibration_samples

  Show description for 28f8bca
  brian-dellabetta

  committed
  28f8bca

  Copy full SHA for 28f8bca

• fix pile dataset issue

  Show description for 2226bfd
  brian-dellabetta

  committed
  2226bfd

  Copy full SHA for 2226bfd

Commits on Feb 24, 2025

• updated config dataclasses

  Show description for 5ca7eb2
  brian-dellabetta

  committed
  5ca7eb2

  Copy full SHA for 5ca7eb2

Commits on Feb 25, 2025

• OOM error resolved

  Show description for 405aeb3
  brian-dellabetta

  committed
  405aeb3

  Copy full SHA for 405aeb3

• codereview updates

  Show description for e819fcd
  brian-dellabetta

  committed
  e819fcd

  Copy full SHA for e819fcd

• minor touchups

  Show description for e801307
  brian-dellabetta

  committed
  e801307

  Copy full SHA for e801307

Commits on Mar 3, 2025

• updates from debugging

  Show description for 386ead2
  brian-dellabetta

  committed
  386ead2

  Copy full SHA for 386ead2

Commits on Mar 4, 2025

• styling

  Show description for 32b0b53
  brian-dellabetta

  committed
  32b0b53

  Copy full SHA for 32b0b53

Commits on Mar 5, 2025

• slightly improved rtn calculate_qparams logic

  Show description for 31884cf
  brian-dellabetta

  committed
  31884cf

  Copy full SHA for 31884cf

Commits on Mar 10, 2025

• code cleanup

  Show description for b03124a
  brian-dellabetta

  committed
  b03124a

  Copy full SHA for b03124a

• rename smoothquant private vars

  Show description for 4488a8c
  brian-dellabetta

  committed
  4488a8c

  Copy full SHA for 4488a8c

• Merge branch 'main' into bdellabe/awq-modifier-v3

  brian-dellabetta

  authored
  1e90168

  Copy full SHA for 1e90168

• address gh comment on updating offloaded parameter

  Show description for b464290
  brian-dellabetta

  committed
  b464290

  Copy full SHA for b464290

• drop pile dataset, lint error fixes

  Show description for e0cb4d4
  brian-dellabetta

  committed
  e0cb4d4

  Copy full SHA for e0cb4d4

• style fixes

  Show description for 06a12bf
  brian-dellabetta

  committed
  06a12bf

  Copy full SHA for 06a12bf

Commits on Mar 11, 2025

• fix update_offload_parameter

  Show description for 38d1548
  brian-dellabetta

  committed
  38d1548

  Copy full SHA for 38d1548