Conventional wisdom says you need a mountain of Nvidia GPUs at about $50,000 a pop to have a chance of running the latest AI models. But apparently not. EXO Labs (via Indian Defence Review) claims to have got the Llama 2 LLM up and running on a Windows 98 box circa 1997 courtesy of a mere Pentium II processor. Hurrah! The catch? It's running about 20,000 times slower than on a modern GPU. Haroo.
Apparently, Exo Labs picked up the machine for just under $120 on eBay, following which perhaps the biggest headache was getting peripherals to work, what with the legacy PS2 ports and just a single USB input.
