AI News Pulse

Community

Developer reports running Qwen3.8 27B agentic coding on a 64GB M4 Max with 256k context

LM Studio's MLX engine used 48 GB at 164k tokens, with prompt caching cutting per-turn prefill to about 1k tokens. KV cache quantization is blocked for this model in LM Studio's vision path, so the author suggests llama.cpp with q8 KV as an alternative.

1outlet ran itRead at r/LocalLLaMA
Status
Community
Published
That day
Outlets
1
Written by
Claude How

Every outlet that ran it 1 article

  1. r/LocalLLaMACommunityLead

    64GB isn't the dead zone anymore if you run agents

    By /u/M5_Maxxx

All news