Local ModelsMedium importance
Open project runs Qwen3.5-9B on the GPU of a stock PS4, offline, at 31–39 tokens per second
The author of garlic-llm (u/leonardo_alegria) showed on r/LocalLLaMA Qwen3.5-9B running on a stock PS4, with no cloud and no Linux, at 31–39 tokens per second. According to him, what helped most was the MTP head that ships with Qwen3.5: it drafts up to two tokens and the full model checks them in one pass, which raised the speed from 22 to 31–39 tokens per second. The weights were repacked into custom 4- and 3-bit formats to fit in about 4.5 GiB. The code and download are open.
Published in edition no. 29 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
Original source
r/LocalLLaMACode on GitHubDownload on Hugging Face
https://www.reddit.com/r/LocalLLaMA/comments/1xvbn2m/qwen359b_running_on_a_ps4s_gpu_offline_using_its/