Continuous Batching: Scheduling at Iteration Granularityđ Apr 22, 2026 · â 9 min read · âī¸ k4iHow iteration-level scheduling eliminates GPU idle time, and how prefill and decode rows can share one packed forward pass.
