[Continuous batching] Initial cb test#52

Merged

yannicks1 merged 20 commits intodev-continuous-batchingfrom

Apr 7, 2025

Commits on Mar 26, 2025

initial cb test
nikolaospapandreou
committed

Commits on Mar 28, 2025

make tkv, active_pages optional in SpyreCausalLM class for the V0 tests
nikolaospapandreou
committed

Commits on Apr 4, 2025

Commits on Apr 5, 2025

removing unsused class variables, simplifying code
yannicks1
committed
use VLLM_SPYRE_MAX_BATCH_SIZE to control (decoding) batch size on AIU Spyre
yannicks1
committed

Commits on Apr 7, 2025