Local ModelsMedium importance
KQuant: new 4-bit packs for Qwen models on the Mac promise to stay up to 3.7 times closer to the original model
An engineer at Nace, the company behind the open Drex model, presented KQuant on r/LocalLLaMA, a quantization technique (compressing weights to fit in less memory) made, according to him, with Claude Fable 5.2, GPT-6 Astra and 128 subagents. The packs come in MLX, for Mac, free on Hugging Face, for Qwen3.5-4B and 9B, Qwen3.8-27B, Qwen3.6-35B-A3B and Qwen3.8-Flash-Next, with GGUF versions promised later. By the author's KL divergence measurements (how far predictions drift from the full model, not a task score), the Flash-Next Q4 stays 3.7 times closer to the original than the public 4-bit pack, and is smaller (105.2 vs. 110.6 GB); for the others, the advantage ranges from 1.45 to 2.6 times. He also says the packs run 6% to 15% faster on the M5 Pro. The numbers are the author's own.
Published in edition no. 26 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
Original source
https://www.reddit.com/r/LocalLLaMA/comments/1xu9onk/kquant_new_quantization_technique_37_better/