Research
SpecPilot uses an agentic loop to speed up speculative decoding
The paper reports SpecPilot raises speedup over autoregressive decoding from 4.46x to 10.87x with one request, and from 1.94x to 3.93x with batching, without training or quality loss.