Totally agree on the response time. OpenAI etc have been non starters for me. I'm excited/experimenting with attaching https://ollama.com/ https://ollama.com/

Totally agree on the response time. OpenAI etc have been non starters for me. I'm excited/experimenting with attaching https://ollama.com/ https://ollama.com/ though. It is so much faster it's starting to feel ok. A lot changes when we just assume that everyone's computer can run LLM locally I think.