Skip to content

Commit d93e182

Browse files
committed
bash format
Signed-off-by: Sophie du Couédic <[email protected]>
1 parent 6c48227 commit d93e182

File tree

1 file changed

+12
-10
lines changed

1 file changed

+12
-10
lines changed

docs/contributing/continuous_batching/overview.md

Lines changed: 12 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -48,18 +48,21 @@ For `long_context.py`: the same parameters, but with some differences:
4848
* Scheduler Steps Tests: `vllm-spyre/tests/e2e/test_spyre_cb_scheduler_steps.py`
4949
* Other Tests: various files including `vllm-spyre/tests/e2e/test_spyre_cb.py`
5050

51+
<!-- markdownlint-disable MD031 MD046 -->
5152
### Usage (when running locally)
53+
5254
#### Commands
53-
```bash
54-
# Runs all the tests
55-
python -m pytest -svx -m "spyre and cb" --forked tests
5655

57-
# Runs specific test file
58-
python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_cb_scheduler_steps.py
56+
# Runs all the tests
57+
python -m pytest -svx -m "spyre and cb" --forked tests
58+
59+
# Runs specific test file
60+
python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_cb_scheduler_steps.py
61+
62+
# Runs specific test function
63+
python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_basic.py::test_output
5964

60-
# Runs specific test function
61-
python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_basic.py::test_output
62-
```
65+
<!-- markdownlint-enable MD031 MD046 -->
6366

6467
#### Parameters description
6568
* `-x` option: stops the execution as soon as a test fails
@@ -69,7 +72,7 @@ python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_basic.py::
6972
* `-m "spyre and cb"`: runs the tests with configurations marked as "spyre" and "cb" only
7073

7174
!!! tip
72-
To run a test with a different model than the default `ibm-ai-platform/micro-g3.3-8b-instruct-1b`, you can run the test with `VLLM_SPYRE_TEST_MODEL_LIST` environment variable set to the targer model, for example:
75+
To run a test with a different model than the default `ibm-ai-platform/micro-g3.3-8b-instruct-1b`, you can run the test with `VLLM_SPYRE_TEST_MODEL_LIST` environment variable set to the targer model, for example:
7376
```bash
7477
VLLM_SPYRE_TEST_MODEL_LIST='tiny-granite-3.2-8b' python -m pytest -svx -m "spyre and cb" --forked tests/e2e/test_spyre_cb.py
7578
```
@@ -97,7 +100,6 @@ Output tests checks the correctness of the output of CB on a set of prompts. For
97100
This applies for sendnn backend, on CPU the tokens need to additionally be exactly the same for the test to pass
98101
* The test passes if: the logprobs of HF on CPU and vLLM (on Spyre or CPU depending on the backend) are compared, and the test passes only if the pairwise relative differences of the values are all below a threshold: `math.isclose(hf_logprob, vllm_logprob, rel_tol=0.35)`. Otherwise it fails. There is no logic that takes into account the fact that the tokens might becomes different at some point, making the logits diverging.
99102

100-
101103
#### Scheduler Steps Tests
102104

103105
See [Scheduler Steps Tests](tests/scheduler_steps_tests.md)

0 commit comments

Comments
 (0)