Social buzzRedditLow importance
User compares local models and Claude on 9 real bugs, and a local Qwen3.8-Flash-Next comes close to Haiku
Instead of measuring speed, an r/LocalLLaMA user tested models on 9 real, private bugs, running the local ones on two RTX 5070 Ti cards. On his scoreboard, Claude Opus 5.5 scored 0.74, Sonnet 5.5 scored 0.58, Qwen3.8-Flash-Next in NVFP4 scored 0.50 (0.48 in 3 bits), Haiku 5.5 scored 0.47, Qwen3.8-27B in 3 bits scored 0.39 and Gemma 4 26B-A4B only 0.07. Scores were given by Opus 5 as judge, and the author himself warns that the margin of error is about 0.2, so the sample is small.
Published in edition no. 6 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese