Recently I watched a startup demo where they were running 500 GPT-4 queries per user session. In 2023, that would have cost them $5 per user. Today it costs them less than 50 cents. And they’re still complaining about API costs being too high.
When costs collapse, new worlds appear. This isn’t just cost-cutting. It’s a phase change.
