Doesn’t it seem like a different lifetime when we didn’t have to worry about maxing out our LLM tokens? After hitting my limit repeatedly, I decided to figure out some hacks. And they are surprisingly simple.
On a long road trip, you don’t leave the engine running while you stop for coffee. You don’t take detours without reason. LLM tokens work similarly. You have a tank. Every word in and every word out draws it down.