Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tests for examples #149

Merged
merged 32 commits into from
Sep 27, 2024
Merged

Conversation

dbarbuzzi
Copy link
Collaborator

@dbarbuzzi dbarbuzzi commented Sep 9, 2024

SUMMARY:
This PR adds automated tests for (most of) the content in the examples folder:

  • examples/finetuning is not covered
  • examples/quantizing_moe/deepseek_moe_w4a16.py is covered but skipped due to exceptionally long run time

The general testing approach covers some of the 'install' snippets as well as the example commands in the READMEs, as well as running the various other example scripts within the covered folders. The commands/scripts are plainly executed and deemed passing as long as the execution completes successfully (i.e., exit code 0) — no further validation occurs.

TEST PLAN:
Automation is configured internally. There is one failure that is reported and unrelated to the automation code itself.

@dbarbuzzi dbarbuzzi force-pushed the add-examples-tests branch 3 times, most recently from 915cb31 to e123f8a Compare September 12, 2024 19:27
@dbarbuzzi dbarbuzzi force-pushed the add-examples-tests branch 2 times, most recently from f010ffa to 1eadb8a Compare September 19, 2024 15:47
Copy link
Collaborator

@andy-neuma andy-neuma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looking good

Copy link
Collaborator

@rahul-tuli rahul-tuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great Job @dbarbuzzi

@mgoin mgoin merged commit f00c960 into vllm-project:main Sep 27, 2024
6 of 7 checks passed
@dbarbuzzi dbarbuzzi deleted the add-examples-tests branch October 7, 2024 14:01
markmc pushed a commit to markmc/llm-compressor that referenced this pull request Nov 13, 2024
)

* add error

* Update src/compressed_tensors/quantization/quant_args.py

Co-authored-by: Dipika Sikka <[email protected]>

* remove extra line

* fix invalid configs it tests

---------

Co-authored-by: Dipika Sikka <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants