Lift max_batch_size=1 under EP=2 via head↔worker slot multiplexing (#99) - #101

Merged

tbraun96 merged 10 commits into

Avarok-Cybersecurity:mainfrom

camerono:pr/ep-batched-decode

Jun 3, 2026

Commits on May 28, 2026

spark-model: add ep_broadcast_seq_and_cmd helpers for batched-EP protocol
camerono
committed
spark-server: head emits seq_id preamble at EP broadcast kickoff sites
camerono
committed
spark-model: worker dispatches multi-slot via seq_id preamble
camerono
committed
spark-server: pre-allocate EP worker slots + retire skip-compaction
camerono
committed
spark-server: lift max_batch_size clamp under EP v2
camerono
committed
spark-model: d2d copy instead of host-staging in EP decode_batch
camerono
committed
spark-model: batched-EP via 0xFFFFFFE0 protocol + grouped-MoE in multi-seq decode
camerono
committed

Commits on May 29, 2026