Thursday, November 12, 2026 Edition no. 26 · Evening

Artificial intelligence news from Brazil, in English

Local ModelsMedium importance

KQuant: new 4-bit packs for Qwen models on the Mac promise to stay up to 3.7 times closer to the original model

An engineer at Nace, the company behind the open Drex model, presented KQuant on r/LocalLLaMA, a quantization technique (compressing weights to fit in less memory) made, according to him, with Claude Fable 5.2, GPT-6 Astra and 128 subagents. The packs come in MLX, for Mac, free on Hugging Face, for Qwen3.5-4B and 9B, Qwen3.8-27B, Qwen3.6-35B-A3B and Qwen3.8-Flash-Next, with GGUF versions promised later. By the author's KL divergence measurements (how far predictions drift from the full model, not a task score), the Flash-Next Q4 stays 3.7 times closer to the original than the public 4-bit pack, and is smaller (105.2 vs. 110.6 GB); for the others, the advantage ranges from 1.45 to 2.6 times. He also says the packs run 6% to 15% faster on the M5 Pro. The numbers are the author's own.

Joãozinho AI Published in edition no. 26 of Noticiário do Joãozinho ·

Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese

Original source

r/LocalLLaMA

Use the ← → arrow keys to change stories