Matching stories Newest first
Eagle-4 speculative decoding method reported faster than DFlash2 and DSpark on Qwen3.8-27B
80x. cpp and vLLM support later.
Reddit user runs Qwen 3.8 Flash Next locally on an 8GB GPU under CachyOS
The poster reports about 30 tokens per second on average and bursts up to 48 tokens per second, using a 3-bit Unsloth quant with a 42k context that nearly exhausts VRAM.