Matching stories Newest first
Eagle-4 speculative decoding method reported faster than DFlash2 and DSpark on Qwen3.8-27B
A Reddit post shows EAGLE-4 at a 3.59x speedup over vanilla MTP on Qwen 3.8 27B, versus 2.80x for DFlash 2 and 2.57x for DSpark. Only Qwen3.8-27B is supported so far, and llama.cpp and vLLM support is pending.
Ornith-1.5-122B, a Qwen-based finetune, released in GGUF and NVFP4 formats
Ornith AI introduces Ornith-1.5, which continuously generates its own training tasks and improves through reinforcement learning, extending Ornith-1.0 built on Qwen3.5 and Gemma4. GGUF and NVFP4 builds are on Hugging Face, with more details in the company blog.
Community post shares a Qwen prompt that makes the model draft and refine iteratively
A Reddit user reports that adding a fractal draft-test-refine prompt to Qwen 3.8 Flash Next made it faster and more decisive in their own projects. The claims are anecdotal and no benchmarks are given.
ISTA-DASLab releases a Qwen3.8-27B prefiller model that streams from SSD for low-quant accuracy
The demo recovers accuracy for low-bit quantized Qwen3.8-27B while keeping VRAM usage low and decoding fast. It reportedly needs an Nvidia Blackwell GPU, and the poster has not tested it. For context longer than about 4k tokens, the poster expects no speed penalty.
Reddit user asks how to annotate 500 images for fine-tuning Meta DETR
A community post seeks advice on annotation tools, using Grounding DINO or OWLv2 for pre-annotation, and quality control for a small object-detection dataset. It contains no new model news.
Tess-4.5-27B, a Qwen finetune, claims 25% fewer tokens at the same score
Community finetune by migtissera built on Qwen3.8-27B, with GGUF files on Hugging Face. The author reports 25% fewer tokens across 150 BenchLocal scenarios and 43% fewer on data extraction, with the same scores claimed.
Developer proposes entropy-gated adaptive thinking for LLMs with parallel reasoning trees
A Reddit post describes using entropy per token to trigger extra thinking blocks, with parallel branches chosen by JEV logic. The author shares an open-source GitHub repo and says the idea targets local models that can run multiple streams.