Saturday, November 14, 2026 Edition no. 29 · Morning

Artificial intelligence news from Brazil, in English

Local ModelsMedium importance

Open project runs Qwen3.5-9B on the GPU of a stock PS4, offline, at 31–39 tokens per second

The author of garlic-llm (u/leonardo_alegria) showed on r/LocalLLaMA Qwen3.5-9B running on a stock PS4, with no cloud and no Linux, at 31–39 tokens per second. According to him, what helped most was the MTP head that ships with Qwen3.5: it drafts up to two tokens and the full model checks them in one pass, which raised the speed from 22 to 31–39 tokens per second. The weights were repacked into custom 4- and 3-bit formats to fit in about 4.5 GiB. The code and download are open.

Joãozinho AI Published in edition no. 29 of Noticiário do Joãozinho ·

Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese

Original source

r/LocalLLaMACode on GitHubDownload on Hugging Face

Use the ← → arrow keys to change stories