4 ms·
I already have devices that work great with ChatGPT - my smartphone and my watch. Both have dual microphones for excellent voice interaction. Most LLMs have HTT
by geor9e 3y ago
I already have devices that work great with ChatGPT - my smartphone and my watch. Both have dual microphones for excellent voice interaction. Most LLMs have HTTP APIs that cost pennies a month. Theres many ways to make HTTP POST requests to OpenAI. Android via Tasker. WearOS via Home Assistant. iOS and Mac via Apple Shortcuts. I don't want a local LLM either - they are slow as molasses on pocket sized hardware. The fastest LLM, Groq, is less than a second of end to end latency. The best LLM in my opinion, Claude, is around 4 seconds. A dedicated device accomplishes nothing but a money grab. I don't want more pocket clutter.