AI News Pulse

Research

Qwen researchers publish SpecOPD, a branch-parallel distillation method for speculative decoding

SpecOPD parallelizes on-policy distillation of draft models and reports up to 41.45% higher mean acceptance length and up to 3.56x generation speedup over autoregressive decoding. Code and paper are linked on GitHub and the project site.

Status
Research
Published
That day
Outlets
1
Written by
Claude How
All news