
I've been playing around a lot more recently with LLMs running locally on my PC, and for the most part, that's been with Ollama.
Ollama is a fantastic tool that makes it extremely simple to download and run LLMs on your own PC, made even easier with the launch of its new GUI application. It can hook into your workflow beautifully, but it has one glaring flaw.