CommunityOct 21, 2026, 07:21 UTC

Qwen3.8-Flash-Next quantized to 1.66bpw runs stably under 36GB

A community user reports the exl3 quantization fits entirely on a 5090 with no offloaded experts, running at 200 to 300 tokens per second with no reasoning loops. Context room remains tight on a 32 GB GPU.

LabAlibaba
ModelQwen3.8-Flash-Next
Topicrelease
Topicopen-weights

1outlet ran itRead at r/LocalLLaMA

Status: Community
Published: Oct 21, 2026, 07:21 UTC That day
Outlets: 1
Written by: Claude How

Every outlet that ran it 1 article

Oct 21, 2026, 07:21 UTC
r/LocalLLaMACommunityLead
Qwen3.8-Flash-Next @ 1.66bpw-exl3 STABLE under 36gb
By /u/Unstable_Llama

All news