4 ms·
Show HN: GodMode – open-source AI Chat Browser
Hi HN, we're Sean, Alec, and swyx, and we've been hacking on this side project that harmonizes all the major AI chat apps (Closed LLMs, Open Source Hosted LLMs, and Local/GGML ones too) and lets you invoke them in one keyboard shortcut.
I originally made this as a smol menubar app that could quickly access ChatGPT from wherever I was on desktop. This necessitated writing an Electron app, rather than a Chrome extension. I also didn't have access to the GPT-4 API at the time, so I preferred to use GPT-4 via the full webapp.
Then Bing came out strong, and Bard, and Claude, and Llama, and Vicuna, and Falcon and on and on, and other people kept reporting amazing SOTA results on model after model and I felt hopelessly behind - either you just take benchmark results at face value, or you spend serious time copying and pasting chats just to get a feel for the practical differences between the various closed/open source LLMs.
The real value came when I started just running every query past 3-5 chats at once, and started getting a sense for what each was good at. Bing/You.com is (obviously) good at search, but so is Perplexity. Claude 2 wins about 30% of my code queries vs GPT4. GPT4 and Bard and Bing handle file uploads differently. Llama2 is surprisingly good sometimes but also hopelessly bad at others. And so on. But the answer isn't to pick one daily driver. It's to make it easy to just run them all at once, and swap in/out whenever necessary.
(I've taken to calling this Mixture of Mixture of Experts, akin to the GPT4 rumors geohot dropped on our podcast https://news.ycombinator.com/item?id=36413296 https://news.ycombinator.com/item?id=36413296)
As the app grew in screen real estate (ultrawide monitor people! this is your calling!) and I started needing to copy/paste things more, I realized what we were really building was a full-fledged secondary browser that does a slightly different job than your regular browser. It's nominal first purpose is to just harmonize all chat inputs, but more broadly, I can pipe any arbitrary input to any open/closed LLM without any api key using your own account, and use it to enhance your browsing experience generally without me ever seeing your data. What could you do if you could add intelligence features for ~free to any part of your browsing experience? MS Edge has shown a bit of this potential but why should we be limited to just the Edge browser, or just the sidebar? (you can see the beginnings of our thinking in the alpha PromptCritic feature we just added).
You can see our 1min launch video here: https://twitter.com/swyx/status/1692988634364871032 https://twitter.com/swyx/status/1692988634364871032
We've been hacking on this as a side project, and it's my first ever Electron app using a bunch of gnarly features. The UX has a lot of things to improve (see the open issues... help!) but just wanted to get this out there.
Feedback welcome!
- swyx 3y agoforgot to mention - I've been harboring a mild thesis I call "API wrappers < APP wrappers" - in other words, yeah most of the best AI apps are going to be wrappers of closed models anyway, but SOTA features and experience are usually released in the full webapp long before an API is made available for them. This dates as far back as the launch of ChatGPT itself when the likes of Dan Gross were writing ChatGPT Webapp proxies since no API was available (https://github.com/danielgross/whatsapp-gpt https://github.com/danielgross/whatsapp-gpt). I think this thesis will stand for at least a few years, thats just how the economics of SOTA LLMs is going to work out. re: naming - I've been going with an understated normcore theme for our projects, but our friends took to calling it like a "God View" overseeing all the chat apps. we did a vote on our team and "GodMode" won. I threw in a little shout out to Small Gods, my favorite Terry Pratchett book. It really is like having a bunch of tiny gods living in your laptop responding to your every query.