Add --version flag to guidellm CLI #240
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sjmonson
requested changes
Aug 1, 2025
Signed-off-by: Harshith-umesh <[email protected]>
Signed-off-by: Harshith-umesh <[email protected]>
…ect#230) This PR adds the ability to configure custom request headers and control SSL certificate verification when running benchmarks. * The OpenAIHTTPBackend now supports passing custom headers and a verify flag to disable SSL verification. * Headers are now merged with the following precedence: CLI arguments (--backend-args), scenario file arguments, environment variables, and then default values. * Headers can be removed by setting their value to null in the --backend-args JSON string. * The --backend-args help text has been updated with an example of how to use these new features. * New documentation has been added for the CLI, configuration options, and supported data formats. * Unit tests have been added to verify the new header and SSL verification logic, as well as the CLI argument parsing. This provides a way to benchmark targets that require custom authentication, other headers, or use self-signed SSL certificates. Signed-off-by: Elijah DeLee <[email protected]>
* Drop the container entrypoint script as GuideLLM has had native support for its features since vllm-project#99 * Make containerfile more rebuild friendly based on vllm-project#213 * Drop the ENV default scenario as it is confusing to users setting CLI args Closes: vllm-project#213 --------- Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Harshith-umesh <[email protected]>
sjmonson
approved these changes
Aug 1, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implements a --version flag for the GuideLLM CLI that displays the current version and exits cleanly.
The
--versionflag is one of the most fundamental and expected features of any CLI tool. It's typically the first flag I try when exploring a new command-line application .Usage
guidellm --version # Output: guidellm version: 0.3.0.dev40The version flag also appears in help output:
Testing
Wrote 7 unit tests which pass successfully: