Social buzzReddit

Language model runs on a 2006 iPod, with 80 MHz and 64 MB of RAM

A user wrote a Rockbox plugin that runs Karpathy's llama2.c with the TinyStories models on an iPod Video 5.5G. Since the device has no floating-point unit, he ported the int8 version to use only integer math, with lookup tables. The 15-million-parameter model (17 MB) is loaded into the music buffer, so you can't listen to music while it runs.