I was at a hackathon in Austin last weekend and saw a team use a local LLM to run their whole demo without any internet.

I mean, it was just a laptop with Ollama on it, but it totally changed how I think about needing cloud APIs for every single project idea I have.

2 comments

2 Comments

What model were they running, and how fast was it?

Oh the model? Pretty sure it was a potato clock hooked up to a hamster wheel. Speed was about one confused calculation per nap time.