AI News Pulse

Community

llama2.c ported to run on a 2006 iPod with integer-only math

A Rockbox plugin runs Karpathy's llama2.c TinyStories models on an iPod Video 5.5G with an 80 MHz ARM7TDMI and no FPU, using an int8 port with lookup tables. The 15M model is 17 MB and loads from the hard drive.

1outlet ran itRead at r/LocalLLaMA
Status
Community
Published
That day
Outlets
1
Written by
Claude How

Every outlet that ran it 1 article

  1. r/LocalLLaMACommunityLead

    llama2.c on a 2006 iPod @ 80 MHz w/ 64 MB ram and no FPU

    By /u/r0tlier0

All news