File tree Expand file tree Collapse file tree 1 file changed +0
-8
lines changed
docs/contributing/continuous_batching Expand file tree Collapse file tree 1 file changed +0
-8
lines changed Original file line number Diff line number Diff line change @@ -108,13 +108,6 @@ Checking the final output correctness alone is not enough to ensure that CB is c
108108
109109Summary Table Listing all the tests/scripts that can run with CB enabled
110110
111- <style >
112- .summary tr :nth-child (9 ) { background : grey ; }
113- .summary tr :nth-child (3 ) tr :nth-child (2 ) { background : blue ; }
114- </style >
115-
116- <div class =" summary " >
117-
118111| Script / Test | Output Checked | model | Context Length | TP | max_num_seqs | num_prompts | prompts_length | Max tokens |
119112| :-------------------------------------------- | :------------: | :-----------------------: | :------------: | :---: | :----------: | :---------: | :------------------: | :-------------------: |
120113| offline_inference/cb_spyre_inference.py | ✅ | Any | Any | Any | Any | Any | Chicken soups (tbd) | Any |
@@ -127,6 +120,5 @@ Summary Table Listing all the tests/scripts that can run with CB enabled
127120| test_spyre_online.test_openai_serving_cb() | ❌ | micro-g3.3-8b-instruct-1b | TODO | TODO | TODO | TODO | TODO | TODO |
128121| test_spyre_cb.test_cb_max_tokens() | ❌ | micro-g3.3-8b-instruct-1b | 256 | 1 | 2 | 1 | 256 | 20 |
129122
130- </div >
131123
132124<span style =" color :grey " >** test_spyre_cb.test_cb_max_tokens(): Test runs on CPU only** </span >
You can’t perform that action at this time.
0 commit comments