13 ms·

Show HN: I made an app to use local AI as daily driver

637 points by xyc 3y ago

Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver. Zero config setup, supports multi-modal chat, chat with multiple models in the same session, link your own gguf file. - Import ChatGPT history. This is probably my favorite feature. Import your hundreds of messages, search them and even continuing previous chats using local AI offline. - Full text search. Search for hundreds of messages and see results instantly. - Private and capable of working completely offline. Thanks to the amazing work of @ggerganov on llama.cpp which made this possible. If there is anything that you wish to exist in an ideal local AI app, I'd love to hear about it.

gnomodromo 3y ago
I wonder how much space it takes.
machiaweliczny 3y ago
Will it work fine on Macbook Air M2 16GB ?
chaxor 3y ago
This looks fantastic on macos. I like the project. What does this have that is better than https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui ?
xyst 3y ago
I'll give it a shot. Appreciate the effort on keeping it local.
maxfurman 3y ago
Won't work on my Intel Macbook :-(
- oxonia 3y ago
  This is disappointing. Anything similar available for Intel Macs?
jedberg 3y ago
The app is great but honestly I'm impressed with the home page! Can you go into more details on how you made the home page? What did you use to make the screenshots, and are you using any tools to generate the HTML/CSS/etc?
- mvdtnz 3y ago
  Seriously? It grinds my phone to a near halt just trying to scroll from top to bottom. Worse in Firefox but still pretty bad in chrome.
  - jedberg 3y ago
    Interesting. I was using my PC to view it and it was fast and beautiful.
- xyc 3y ago
  Thanks! honestly it's a quick hack together compared to the app. screenshots are from screen.studio. website is built with https://astro.build https://astro.build
matthewmcg 3y ago
The headline had me thinking you had a DIY self-driving car for a moment there. Didn't initially register that this was just the common metaphor. Looks like a great app.
bonestamp2 3y ago
You will sell more if instead of telling us it's for "chatting with local AI" you tell us what we can accomplish by chatting with local AI. I don't need to chat, I need to get certain tasks done. What tasks can it do? (Don't answer me, put it on your landing page and app store listing)
brigleb 3y ago
Cool, instant buy for me. A few little suggestions: - Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well? - A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going. - Would be great if Command-comma opened settings, like most Mac apps. - Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing!
- xyc 3y ago
  Thank you! and thanks so much for the feature suggestions: - Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well? Reasonable request! Won't be too hard to add - A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going. Yes better onboarding wizard would definitely make this easier for beginners. Don't have much capacity right now, but I'll keep this in mind. - Would be great if Command-comma opened settings, like most Mac apps. Nice suggestion. Will probably get to this when I add some keyboard shortcuts like new chat / search etc. - Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing! Ah that's odd, it's supposed to open the link. which link do you have if you don't mind sharing? (feel free to email support@recurse.chat)
k2enemy 3y ago
It would be cool to have the option to use the OpenAI API as well in the same interface. http://jan.ai http://jan.ai does this, so that's what I'm using at the moment.
belgriffinite 3y ago
[flagged]
sneak 3y ago
You can’t buy these apps from the Apple store without providing identity to Apple in the form of a phone number (required for an Apple ID) and linking it to a hardware serial number (the app store app transmits this). It would be nice to be able to buy the app directly from you, instead of putting a surveillance company in the loop. I don’t use an Apple ID on a macintosh. (I would like to avoid using one on an iPhone/iPad/Vision Pro/AppleTV, but it is impossible to install apps on those without one. Please do not bring this terrible circumstance to be the default on macs, too.)
CGamesPlay 3y ago
Possibly a strange question, but do you have plans to add online models to the app? Local models just aren't at the same level, but I would certainly appreciate a consistent chat interface that lets me switch between GPT/Claude/local models.
- deleted 3y ago
  [deleted]
- xyc 3y ago
  Not strange at all! It's a very valid ask. The focus is local AI, but GPT-3.5/GPT-4 are actually included in the app (bring your own key), although customization is limited. Planning to expose some more customizability there including API base urls / model names.
- castles 3y ago
  https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%20Llava%2C%20WizardCoder%20Python%20and%20custom%20GGUF%2C%20as%20well%20as%20OpenAI%20GPT%2D3%20and%20GPT%2D4%20models https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%...
  - christiangenco 3y ago
    ...how did you highlight a specific sentence like that?
    - sandyarmstrong 3y ago
      Looks like a Chromium-specific feature: https://web.dev/articles/text-fragments https://web.dev/articles/text-fragments Pretty cool. Doesn't work on Firefox.
      - QuinnyPig 3y ago
        It just worked on Safari on iOS. That’s pretty impressive.
raajg 3y ago
looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Another tip, I try out a new chat interface to LLMs almost every week and they're free to use initially. There isn't a compelling reason for me to spend $10 from the get to for a use case that I'm not sure about yet.
- FloorEgg 3y ago
  Maybe this isn't for everyone, just the people who place a high value on privacy.
  - ukuina 3y ago
    But how can I guarantee this app is private? I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.
  - giblfiz 3y ago
    I mean, ok, then how do you distinguish yourself from LM Studio (Free)
  - vunderba 3y ago
    If your ultimate goal is privacy, then you should only be looking at open source chat UI front ends: https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI And then connecting them to off-line models servers: - Ollama - llama.cpp And you should avoid closed source frontends: - Recurse - LM Studio And closed source models - ChatGPT - Gemini
    - copperx 3y ago
tkgally 3y ago
For an app like this, I would really like a spoken interface. Any possibility of adding text-to-speech and speech-to-text so that users can not only type but also talk with it?
- xyc 3y ago
  yes I wish it could talk. It's after other priorities though, but I might try something experimental.
girishso 3y ago
I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.
- spiderfarmer 3y ago
  Next version of MacOS will probably have that.
  - tethys 3y ago
    As long as you use Safari for browsing, Notes for note taking, iCloud for mail …
- Fnoord 3y ago
  I use paperless-ngx for that.
- xyc 3y ago
  Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.
  - chaostheory 3y ago
    Yeah, we’re getting closer to “Her”
  - _boffin_ 3y ago
    Good to know there's a market for that. Currently building out something. Integrating from numerous sources, processing and then utilizing those. nice.
  - ssnri 3y ago
    I would even let it have longer processing times for queries to apply against each document in my system, allow it to specialize/train itself on a daily basis… Use all the resources you want if you save me brainpower
rbtprograms 3y ago
Looks great! Does it support different sized models, i.e. can I run llama 70B and 7B, and is there a way to specify which model to chat with? Are there plans to allow users to ingest their own models through this UI?
- xyc 3y ago
  If you have a gguf file you can link it. For ingesting new models - I'm thinking about adding some CRUD UIs to it, but I'd like to keep a very small set of default models.
  - rbtprograms 3y ago
    thanks, its a great project
3abiton 3y ago
How different is this compared to Jan.ai for example?
- xyc 3y ago
  as i understand jan.ai is more focused on enterprise / platform, while I'd see where recursechat would go is more like "obsidian.md" but as your personal AI.
  - gexla 3y ago
    Obsidian has add-ons which do much of this.
    - internetter 3y ago
      People are treating Obsidian like it's the next Emacs
rexreed 3y ago
What are the MacOS and hardware requirements? How does it perform on a slightly older model, lower powered Mac? I wish I could test this to see how it would perform, and while it's only $10, I don't want to spend that just to realize it won't work on my older, underpowered Mac mini.
- xyc 3y ago
  Good question, I'll put some system requirements on the website. It only supports mac with Apple Silicon now, if that's helpful.
  - pantulis 3y ago
    Instant buy, great work and the price point is exactly right. Good luck!
    - xyc 3y ago
      Appreciate your support. Thank you so much!
Linda231 3y ago
[dead]
pentagrama 3y ago
Congrats! Plans on Windows support?
- xyc 3y ago
  Thanks! Sorry no immediate plan. People have recommended Chat with RTX so it might be worth checking out. https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat...
  - appel 3y ago
    It looks amazing, OP! I'm sad I'm missing out as a Windows user.
- theolivenbaum 3y ago
  You can try https://curiosity.ai https://curiosity.ai, supports Windows and macOS
giblfiz 3y ago
So there are a few questions that leap out at me: * What are you using for image generation? Is that local as well (stable diffusion?) Does it have integrated prompt generation? * You mention the ability to import ChatGPT history, are you able to import other documents? * How many "agent" style capacities does it have? Can it search the web? use other APIs? Prompt itself? * Does it have a plugin framework? you mention that it is "customizable" but that can mean almost anything. * What is the license? what assurances do users have that their usage is private? I mean, we all know how many "local" apps exfiltrate a ton of data.
- hanniabu 3y ago
  > What are you using for image generation? It doesn't look like it supports image generation unfortunately. If it did then I would definitely adopt this as my daily driver.
android521 3y ago
how big is the local model? what is the Mac spec requirement? I don't want to download and find out it won't work in my computer. It seems like the first question everyone would ask and should be addressed on the website.
- visarga 3y ago
  It uses ollama which is based on llama.cpp, and adds a model library with dozens of models in all quant sizes.
  - xyc 3y ago
    no this doesn't use ollama, just based on llama.cpp.
- xyc 3y ago
  Appreciate the feedback! It works on mac with Apple Silicon only. I'll put some system requirements on the website.
pentagrama 3y ago
Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai https://lmstudio.ai - https://msty.app https://msty.app - https://jan.ai https://jan.ai More complex / Unpolished UI: - https://gpt4all.io https://gpt4all.io - https://pinokio.computer https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev https://faraday.dev (AI Characters): No UI / Command line (not for me): - https://ollama.com https://ollama.com - https://privategpt.dev https://privategpt.dev - https://serge.chat https://serge.chat - https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile Pending to check: - https://recurse.chat https://recurse.chat Feel free to recommend more!
- chaxor 3y ago
  What about https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui ? Seems to have more features than all of them
- chown 3y ago
  I am the author of Msty app mentioned here. So humbled to see an app that is just about a month old that I mostly wrote for my wife and some friends to begin with (who got overwhelmed with everything that was going in LLM world), on the top of your list. Thank you!
  - hanniabu 3y ago
    1) What are the mac system requirements? Does it need a specific OS version? 2) If you're privacy first, many would feel a lot more comfortable if this was released as an app in the app store so it will be sandboxed. This is important because it's not open source so we have no idea what is happening in the background. Alternatively open source it, which many here have requested.
  - petemir 3y ago
    If you need help for testing the Linux version let me know, I’d be happy to help
bradnickel 3y ago
Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity. Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.
- hanniabu 3y ago
  What's your farcaster?
- xyc 3y ago
  Thank you so much for the support! Simplicity is power indeed. I'm on twitter: https://x.com/chxy https://x.com/chxy
- bradnickel 3y ago
  Found your Twitter account in a previous post. Just tagged you.
  - xyc 3y ago
    Awesome, thanks for the tag!
xyc 3y ago
Wow, I did not expect at all this will end up on the front page. Thank you for all the enthusiasm, I'll try to get to more questions later today but if there's something I missed my X/twitter DM is open: https://x.com/chxy https://x.com/chxy
- castles 3y ago
  It seems "local" is all you need :)
sen 3y ago
This is awesome. I currently use Ollama with OpenWebUI but am a big fan of native apps so this is right up my alley.
- xyc 3y ago
  Thank you!
- woadwarrior01 3y ago
  It looks like an Electron app, and not a native app. https://imgur.com/a/pz0kzJ1 https://imgur.com/a/pz0kzJ1
toomuchtodo 3y ago
Hey! This is awesome! How hard would it be to plug it into something like Raindrop.io (bookmark manager) to train on all bookmarks collected?
- xyc 3y ago
  haven't tried Raindrop.io, looks neat! Saw some other posts mentioning bookmarks as well. I'll keep this in thought, but will have to try it out first to find out.
  - toomuchtodo 3y ago
    Appreciate it, thank you.
deleted 3y ago
[deleted]
cooper_ganglia 3y ago
I read the website for 30 seconds and instantly bought it. It's clean, easy to use, and works really well! Easy local server hosting was cool, too. I've used the other LLM apps, and this feels like those, but simplified. It just feels good to use. I like it a lot! I'm gonna test drive it for a while, and if I keep using it regularly, I'll definitely be sending in some feedback. Other users have made a lot of really great recommendations already, I'm excited to see how this evolves!
- xyc 3y ago
  Thanks so much for the kind words and giving it a spin! Feel free to send feedback, issues, feature suggestion as you use it more, I'm all ears. My twitter DM is also open: https://x.com/chxy https://x.com/chxy.
  - madduci 3y ago
    Any chance to see it available on other operating systems as well?
    - xyc 3y ago
      Unfortunately not now. If you are interested in email updates: https://tally.so/r/wzDvLM https://tally.so/r/wzDvLM
devinprater 3y ago
There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me. https://github.com/chigkim/VOLlama/ https://github.com/chigkim/VOLlama/
- chown 3y ago
  It's very nice that there exists something like that. I am an author of one of the similar apps [1] someone listed in a different thread. I was hoping I could get in touch with someone like you who could give me some feedback on how to make my app more accessible for users like you. I really want to it be an "LLM for all" kind of app but despite my best efforts and intention, I suck at it. Any chance of getting in touch with you and get some feedback? Only if you want and have time, no pressure at all. [1] https://msty.app https://msty.app
  - devinprater 3y ago
    Sure, I'll probably join the discord tomorrow morning, but a few notes: * For apps like this, using live regions to speak updates may be helpful. either that or change the buttons, like from "download local AI" to "configuring." Maybe a live region would be best for that one since sighted people would probably be looking near the bottom for the status bar, but anyway... * Using live regions for chats is pretty important, because otherwise we don't know when a message is ready to read, and it makes reading those messages much simpler. The user types the message, presses Enter, and the screen reader reads the message to them. So, making a live region, and then sending the finished message, or a finished part of a message, to that live region would be really helpful. * Now on to the UI. At the top, we have "index /text-chat-sessions". I guess that should just say "chats"? Below that, we have a list, with a button saying the same thing. After that list with one item, is a button that says "index /local-ai". That should probably just be "local AI". Afterwards, there is "index /settings", which should just be "settings." Then, there is an unlabeled button. I'm guessing this is styled to look like a menu bar, across the top of the window, so it'd be the item on the right side. Now, there's a button below that that says "New Chat^N". I, being a technical user, am pretty sure the "^N" means "Control + N", but almost no one else knows that. So, maybe change that text label. Between that and the Recent Chats menu button are two unlabeled buttons. I'm not sure why a region landmark was used for the recent chats list, but after the chat name "hello" in this case, where I can rename the chat, there is an unlabeled button. The button after the model chooser is unlabeled as well. After the user input in the conversation, there are three unlabeled buttons. After the response, there is a menu button with (oh, that's cool) items to transform the response into bullets, a table, ETC. but that menu button was unlabeled so I had to open it to see what's inside. After that, all other buttons, like for adding instructions to refine this message, are also unlabeled. So, live regions for speaking chat messages and state changes like "loading" or "ready" or whatever (keep them short), and label controls, and you should be good to go. Live regions: https://developer.mozilla.org/en-US/docs/Web/Accessibility/ARIA/ARIA_Live_Regions https://developer.mozilla.org/en-US/docs/Web/Accessibility/A...
SkepticMystic 3y ago
I've found great utility with `llm` https://llm.datasette.io https://llm.datasette.io, a CLI to interact with LLMs. It has plugins for remote and local models.
- xyc 3y ago
  Good to know. I've learned lots of things from Simon Willison's blog (datasette's author), so can't imagine llm being unuseful.
geniium 3y ago
I am very glad to see that kind of app. Well done!
rkuodys 3y ago
Honest question - can it be used for programming? Or anyone maybe can recommend local-first development LLM which would take in all project (Python / Angular) and write code based on full repo, not only the active window as with Copilot or Jetbrains AI
- arzke 3y ago
  Have you tried using Copilot's @workspace command in the chat?
- _ink_ 3y ago
  Check out the continue dev plugin (available for VS Code and Jetbrains). You can attach it to OpenAI or local models and it can consider files in your codebase. It has a @Codebase keyword, but so far I get better results in specifically pointing to the needed files.
surrTurr 3y ago
any plans on supporting ollama integration?
code51 3y ago
Thank you for the work. Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though. ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what it's trying to do.
- kvakkefly 3y ago
  Dangerously close to the old famous Dropbox comment to the original ShowHN post
- ayhoung 3y ago
  Not everyone is a dev
  - Alifatisk 3y ago
    HN users keep forgetting that
- vood 3y ago
  Thanks for sharing ChatbotUI. While I'm not an author, I use it extensively and contribute to it. Thanks to the permissive license, I could offer ChatbotUI as a hosted solution with our API keys. https://labs.writingmate.ai https://labs.writingmate.ai.
911e 3y ago
Not a bit of open code while I'm 100% sure they use some that require it. If you"re using AI + Your data without insight on how it's used you're a fool. 2 cents
tartrate 3y ago
> Full Text Search. Blazingly fast search over thousands of messages. Natural language processing has come full circle and just reinvented Ctrl+F. I had to double check that a regular '90s search function was actually the thing being advertised here, and sure enough, there is a gif demonstrating exactly that.
- davely 3y ago
  Yeah, I think the call out here is specifically because you the ChatGPT interface doesn't have a search feature (on web). Interestingly, on their iOS app, you can search. I often find myself opening the app on my phone if I want to find a previous conversation, even if I'm at my desk.
  - antifa 3y ago
    The search feature on ChatGPT for Android only works for a tiny number of recent chats.
- Grimblewald 3y ago
  I'm a big fan of ctrl+f, but semantic search is a life saver that conventional search simply cannot compare to.
- Moldoteck 3y ago
  i'm more interested how to perform semantic search over messages efficiently. Like to receive the reference to the og message. Is it creating an llm response with the potential content and how does it find the og message? is it performing tf/idf+cosine search after that or how?
- replwoacause 3y ago
  Yes but this is missing from most chatbot UIs (ChatGPT, Gemini, Claude, etc. ) so is therefore very useful. Machato has it but it is very laggy.
- addandsubtract 3y ago
  Ctrl+F only gets you so far. It doesn't allow you to perform semantic searches, for example. If you don't happen to know a unique word (or set of words) to search for, you're out of luck. Just the other day, I was able to find a song by typing the phonetic pronunciation (well, as best I could) into ChatGPT, and it knew which song I was talking about right away. No way a regular search engine would've helped me there.
ggerganov 3y ago
> Thanks to the amazing work of @ggerganov on llama.cpp which made this possible. If there is anything that you wish to exist in an ideal local AI app, I'd love to hear about it. The app looks great! Likewise, if you have any requests or ideas for improving llama.cpp, please don't hesitate to open an issue / discussion in the repo
- titaniumtown 3y ago
  Wow I've been following your work for a while, incredible stuff! Keep up the hard work, I check llama.cpp's commits and PRs very frequently and always see something interesting in the works (the alternative quantization methods and Flash Attention have been interesting).
- petargyurov 3y ago
  Did not expect to see the Georgi Gerganov here :) How is GGML going? Поздрави!
  - ggerganov 3y ago
    So far is going great! Good community, having fun. Many ideas to explore :-)
- xyc 3y ago
  Oh wow it's the goat himself, love how your work has democratized AI. Thanks so much for the encouragement. I'm mostly a UI/app engineer, total beginner when it comes to llama.cpp, would love to learn more and help along the way.
- duckkg5 3y ago
  Nothing to add except that your work is tremendous
jiriro 3y ago
Out of curiosity – how is this app built?:-) There is a demo clip with a vertical scroll bar which does not fade out as it would do in a native mac app:)
- rangera 3y ago
  Scroll bars don't fade out if you're using a mouse (as opposed to just a trackpad) or if you've set Mac OS Settings > Appearance > Show scroll bars to "Always".
  - jiriro 3y ago
    I see! I’ve not used mouse on a mac:-o Anyway the UI looks not mac native. I’m interested what it is:-)
- Alifatisk 3y ago
  Yeah I am curious what the app is built with. I saw someone mention it's using Electron, so that's a start.
  - SushiHippie 3y ago
    Even with a screenshot https://news.ycombinator.com/item?id=39535755 https://news.ycombinator.com/item?id=39535755
zzz999 3y ago
Any censorship? (Can't try MacOS Apps)
famahar 3y ago
Will this work on an M1 Mac Book Air? Looking for an offline solution like this but wary of hardware requirements.
konschubert 3y ago
I want something that starts as a simple manager for my reminders, something that tells me what to do next. And then, as features are being added, grows into a full-blown personal assistant that can book flights for me.
stuckkeys 3y ago
No iPhone app? Assuming it looks to connect to a local server or are you actually downloading the llms local to the device?
domano 3y ago
Hey, i bought it, nice work! A few things: * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Such a chat ui is not usable for me without this feature. * The feedback button does nothing for me, just changes focus to chrome. * The LLaVA model tells me that it can not generate images since it is a text based AI model. My prompts were "Generate an image of ..."
- xyc 3y ago
  Thank you for the support and the valuable feedback! Sorry about the response time, I haven't expected the incoming volume of requests. * For changing prompt in the middle - I'll take a crack at it this week. It's on top of my post launch list. * Feedback button: Thanks for reporting this. The button was supposed to open default email client to email feedback@recurse.chat * LLaVA model: I'll add more documentation. You are right Llava could not generate images. It can only describe images (similar to GPT-4v). For image generation, it's not supported in the app. While I don't have immediate plans for image generation, check out these projects for local image generation. - https://diffusionbee.com/ https://diffusionbee.com/ - https://github.com/comfyanonymous/ComfyUI https://github.com/comfyanonymous/ComfyUI - https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui
- wodow 3y ago
  > * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Agreed, but what I would also really like (from this and ChatGPT) would be branching: take a conversation in two different ways from some point and retain the seperate and shared history. I'm not sure what the UI should be. Threads? (like mail or Usenet)
  - ItsMattyG 3y ago
    ChatGPT does this. You just click an arrow and it will show you other branches.
bberenberg 3y ago
There are a lot of tools listed in this thread, but I am not seeing the thing I want which is: - Ability to use local and OpenAI models (ideally it has defaults for common local models) - Chat UX - Where I can point it to my JS/TS codebase - It indexes the whole thing including dependencies for RAG. Ideally indexing has some form of awareness of model context length. - I can use it for codegen / debugging. The closest I have found has been aider, but it's python and I get into general python hell every time I try and run it. Would appreciate a suggestion.
ferfumarma 3y ago
Is the haiku example a real Haiku? I think it gives you 4, 7, and 9 syllables in the lines. I bet you can coax it to give you a better example, if you tinker a bit.
howmayiannoyyou 3y ago
Without Apple Shortcuts support I can't pay for this. I get pretty much the same experience from GPT4All. Hoping you add support CLI, Shortcuts or something along those lines.
- xyc 3y ago
  Thanks for the suggestion! I play with Apple Shortcuts sometimes. It's an exemplary example of how easy end user programming could be. Will keep this in mind.
boringg 3y ago
This looks interesting -- might implement it. I'm curious how to ensure that it is local only?

637 points by xyc 3y ago

gnomodromo 3y ago

I wonder how much space it takes.

machiaweliczny 3y ago

Will it work fine on Macbook Air M2 16GB ?

chaxor 3y ago

This looks fantastic on macos. I like the project. What does this have that is better than https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui ?

xyst 3y ago

I'll give it a shot. Appreciate the effort on keeping it local.

maxfurman 3y ago

Won't work on my Intel Macbook :-(

oxonia 3y ago
This is disappointing. Anything similar available for Intel Macs?

jedberg 3y ago

The app is great but honestly I'm impressed with the home page! Can you go into more details on how you made the home page? What did you use to make the screenshots, and are you using any tools to generate the HTML/CSS/etc?

mvdtnz 3y ago
Seriously? It grinds my phone to a near halt just trying to scroll from top to bottom. Worse in Firefox but still pretty bad in chrome.
- jedberg 3y ago
  Interesting. I was using my PC to view it and it was fast and beautiful.
xyc 3y ago
Thanks! honestly it's a quick hack together compared to the app. screenshots are from screen.studio. website is built with https://astro.build https://astro.build

matthewmcg 3y ago

The headline had me thinking you had a DIY self-driving car for a moment there. Didn't initially register that this was just the common metaphor. Looks like a great app.

bonestamp2 3y ago

You will sell more if instead of telling us it's for "chatting with local AI" you tell us what we can accomplish by chatting with local AI. I don't need to chat, I need to get certain tasks done. What tasks can it do? (Don't answer me, put it on your landing page and app store listing)

brigleb 3y ago

Cool, instant buy for me. A few little suggestions: - Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well? - A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going. - Would be great if Command-comma opened settings, like most Mac apps. - Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing!

xyc 3y ago
Thank you! and thanks so much for the feature suggestions: - Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well? Reasonable request! Won't be too hard to add - A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going. Yes better onboarding wizard would definitely make this easier for beginners. Don't have much capacity right now, but I'll keep this in mind. - Would be great if Command-comma opened settings, like most Mac apps. Nice suggestion. Will probably get to this when I add some keyboard shortcuts like new chat / search etc. - Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing! Ah that's odd, it's supposed to open the link. which link do you have if you don't mind sharing? (feel free to email support@recurse.chat)

k2enemy 3y ago

It would be cool to have the option to use the OpenAI API as well in the same interface. http://jan.ai http://jan.ai does this, so that's what I'm using at the moment.

belgriffinite 3y ago

[flagged]

sneak 3y ago

You can’t buy these apps from the Apple store without providing identity to Apple in the form of a phone number (required for an Apple ID) and linking it to a hardware serial number (the app store app transmits this). It would be nice to be able to buy the app directly from you, instead of putting a surveillance company in the loop. I don’t use an Apple ID on a macintosh. (I would like to avoid using one on an iPhone/iPad/Vision Pro/AppleTV, but it is impossible to install apps on those without one. Please do not bring this terrible circumstance to be the default on macs, too.)

CGamesPlay 3y ago

Possibly a strange question, but do you have plans to add online models to the app? Local models just aren't at the same level, but I would certainly appreciate a consistent chat interface that lets me switch between GPT/Claude/local models.

deleted 3y ago
[deleted]
xyc 3y ago
Not strange at all! It's a very valid ask. The focus is local AI, but GPT-3.5/GPT-4 are actually included in the app (bring your own key), although customization is limited. Planning to expose some more customizability there including API base urls / model names.
castles 3y ago
https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%20Llava%2C%20WizardCoder%20Python%20and%20custom%20GGUF%2C%20as%20well%20as%20OpenAI%20GPT%2D3%20and%20GPT%2D4%20models https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%...
- christiangenco 3y ago
  ...how did you highlight a specific sentence like that?
  - sandyarmstrong 3y ago
    Looks like a Chromium-specific feature: https://web.dev/articles/text-fragments https://web.dev/articles/text-fragments Pretty cool. Doesn't work on Firefox.
    - QuinnyPig 3y ago
      It just worked on Safari on iOS. That’s pretty impressive.

raajg 3y ago

looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Another tip, I try out a new chat interface to LLMs almost every week and they're free to use initially. There isn't a compelling reason for me to spend $10 from the get to for a use case that I'm not sure about yet.

FloorEgg 3y ago
Maybe this isn't for everyone, just the people who place a high value on privacy.
- ukuina 3y ago
  But how can I guarantee this app is private? I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.
- giblfiz 3y ago
  I mean, ok, then how do you distinguish yourself from LM Studio (Free)
- vunderba 3y ago
  If your ultimate goal is privacy, then you should only be looking at open source chat UI front ends: https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI And then connecting them to off-line models servers: - Ollama - llama.cpp And you should avoid closed source frontends: - Recurse - LM Studio And closed source models - ChatGPT - Gemini
  - copperx 3y ago

tkgally 3y ago

For an app like this, I would really like a spoken interface. Any possibility of adding text-to-speech and speech-to-text so that users can not only type but also talk with it?

xyc 3y ago
yes I wish it could talk. It's after other priorities though, but I might try something experimental.

girishso 3y ago

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

spiderfarmer 3y ago
Next version of MacOS will probably have that.
- tethys 3y ago
  As long as you use Safari for browsing, Notes for note taking, iCloud for mail …
Fnoord 3y ago
I use paperless-ngx for that.
xyc 3y ago
Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.
- chaostheory 3y ago
  Yeah, we’re getting closer to “Her”
- _boffin_ 3y ago
  Good to know there's a market for that. Currently building out something. Integrating from numerous sources, processing and then utilizing those. nice.
- ssnri 3y ago
  I would even let it have longer processing times for queries to apply against each document in my system, allow it to specialize/train itself on a daily basis… Use all the resources you want if you save me brainpower

rbtprograms 3y ago

Looks great! Does it support different sized models, i.e. can I run llama 70B and 7B, and is there a way to specify which model to chat with? Are there plans to allow users to ingest their own models through this UI?

xyc 3y ago
If you have a gguf file you can link it. For ingesting new models - I'm thinking about adding some CRUD UIs to it, but I'd like to keep a very small set of default models.
- rbtprograms 3y ago
  thanks, its a great project

3abiton 3y ago

How different is this compared to Jan.ai for example?

xyc 3y ago
as i understand jan.ai is more focused on enterprise / platform, while I'd see where recursechat would go is more like "obsidian.md" but as your personal AI.
- gexla 3y ago
  Obsidian has add-ons which do much of this.
  - internetter 3y ago
    People are treating Obsidian like it's the next Emacs

rexreed 3y ago

What are the MacOS and hardware requirements? How does it perform on a slightly older model, lower powered Mac? I wish I could test this to see how it would perform, and while it's only $10, I don't want to spend that just to realize it won't work on my older, underpowered Mac mini.

xyc 3y ago
Good question, I'll put some system requirements on the website. It only supports mac with Apple Silicon now, if that's helpful.
- pantulis 3y ago
  Instant buy, great work and the price point is exactly right. Good luck!
  - xyc 3y ago
    Appreciate your support. Thank you so much!

Linda231 3y ago

[dead]

pentagrama 3y ago

Congrats! Plans on Windows support?

xyc 3y ago
Thanks! Sorry no immediate plan. People have recommended Chat with RTX so it might be worth checking out. https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat...
- appel 3y ago
  It looks amazing, OP! I'm sad I'm missing out as a Windows user.
theolivenbaum 3y ago
You can try https://curiosity.ai https://curiosity.ai, supports Windows and macOS

giblfiz 3y ago

So there are a few questions that leap out at me: * What are you using for image generation? Is that local as well (stable diffusion?) Does it have integrated prompt generation? * You mention the ability to import ChatGPT history, are you able to import other documents? * How many "agent" style capacities does it have? Can it search the web? use other APIs? Prompt itself? * Does it have a plugin framework? you mention that it is "customizable" but that can mean almost anything. * What is the license? what assurances do users have that their usage is private? I mean, we all know how many "local" apps exfiltrate a ton of data.

hanniabu 3y ago
> What are you using for image generation? It doesn't look like it supports image generation unfortunately. If it did then I would definitely adopt this as my daily driver.

android521 3y ago

how big is the local model? what is the Mac spec requirement? I don't want to download and find out it won't work in my computer. It seems like the first question everyone would ask and should be addressed on the website.

visarga 3y ago
It uses ollama which is based on llama.cpp, and adds a model library with dozens of models in all quant sizes.
- xyc 3y ago
  no this doesn't use ollama, just based on llama.cpp.
xyc 3y ago
Appreciate the feedback! It works on mac with Apple Silicon only. I'll put some system requirements on the website.

pentagrama 3y ago

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai https://lmstudio.ai - https://msty.app https://msty.app - https://jan.ai https://jan.ai More complex / Unpolished UI: - https://gpt4all.io https://gpt4all.io - https://pinokio.computer https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev https://faraday.dev (AI Characters): No UI / Command line (not for me): - https://ollama.com https://ollama.com - https://privategpt.dev https://privategpt.dev - https://serge.chat https://serge.chat - https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile Pending to check: - https://recurse.chat https://recurse.chat Feel free to recommend more!

chaxor 3y ago
What about https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui ? Seems to have more features than all of them
chown 3y ago
I am the author of Msty app mentioned here. So humbled to see an app that is just about a month old that I mostly wrote for my wife and some friends to begin with (who got overwhelmed with everything that was going in LLM world), on the top of your list. Thank you!
- hanniabu 3y ago
  1) What are the mac system requirements? Does it need a specific OS version? 2) If you're privacy first, many would feel a lot more comfortable if this was released as an app in the app store so it will be sandboxed. This is important because it's not open source so we have no idea what is happening in the background. Alternatively open source it, which many here have requested.
- petemir 3y ago
  If you need help for testing the Linux version let me know, I’d be happy to help

bradnickel 3y ago

Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity. Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.

hanniabu 3y ago
What's your farcaster?
xyc 3y ago
Thank you so much for the support! Simplicity is power indeed. I'm on twitter: https://x.com/chxy https://x.com/chxy
bradnickel 3y ago
Found your Twitter account in a previous post. Just tagged you.
- xyc 3y ago
  Awesome, thanks for the tag!

xyc 3y ago

Wow, I did not expect at all this will end up on the front page. Thank you for all the enthusiasm, I'll try to get to more questions later today but if there's something I missed my X/twitter DM is open: https://x.com/chxy https://x.com/chxy

castles 3y ago
It seems "local" is all you need :)

sen 3y ago

This is awesome. I currently use Ollama with OpenWebUI but am a big fan of native apps so this is right up my alley.

xyc 3y ago
Thank you!
woadwarrior01 3y ago
It looks like an Electron app, and not a native app. https://imgur.com/a/pz0kzJ1 https://imgur.com/a/pz0kzJ1

toomuchtodo 3y ago

Hey! This is awesome! How hard would it be to plug it into something like Raindrop.io (bookmark manager) to train on all bookmarks collected?

xyc 3y ago
haven't tried Raindrop.io, looks neat! Saw some other posts mentioning bookmarks as well. I'll keep this in thought, but will have to try it out first to find out.
- toomuchtodo 3y ago
  Appreciate it, thank you.

deleted 3y ago

[deleted]

cooper_ganglia 3y ago

I read the website for 30 seconds and instantly bought it. It's clean, easy to use, and works really well! Easy local server hosting was cool, too. I've used the other LLM apps, and this feels like those, but simplified. It just feels good to use. I like it a lot! I'm gonna test drive it for a while, and if I keep using it regularly, I'll definitely be sending in some feedback. Other users have made a lot of really great recommendations already, I'm excited to see how this evolves!

xyc 3y ago
Thanks so much for the kind words and giving it a spin! Feel free to send feedback, issues, feature suggestion as you use it more, I'm all ears. My twitter DM is also open: https://x.com/chxy https://x.com/chxy.
- madduci 3y ago
  Any chance to see it available on other operating systems as well?
  - xyc 3y ago
    Unfortunately not now. If you are interested in email updates: https://tally.so/r/wzDvLM https://tally.so/r/wzDvLM

devinprater 3y ago

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me. https://github.com/chigkim/VOLlama/ https://github.com/chigkim/VOLlama/

chown 3y ago
It's very nice that there exists something like that. I am an author of one of the similar apps [1] someone listed in a different thread. I was hoping I could get in touch with someone like you who could give me some feedback on how to make my app more accessible for users like you. I really want to it be an "LLM for all" kind of app but despite my best efforts and intention, I suck at it. Any chance of getting in touch with you and get some feedback? Only if you want and have time, no pressure at all. [1] https://msty.app https://msty.app
- devinprater 3y ago
  Sure, I'll probably join the discord tomorrow morning, but a few notes: * For apps like this, using live regions to speak updates may be helpful. either that or change the buttons, like from "download local AI" to "configuring." Maybe a live region would be best for that one since sighted people would probably be looking near the bottom for the status bar, but anyway... * Using live regions for chats is pretty important, because otherwise we don't know when a message is ready to read, and it makes reading those messages much simpler. The user types the message, presses Enter, and the screen reader reads the message to them. So, making a live region, and then sending the finished message, or a finished part of a message, to that live region would be really helpful. * Now on to the UI. At the top, we have "index /text-chat-sessions". I guess that should just say "chats"? Below that, we have a list, with a button saying the same thing. After that list with one item, is a button that says "index /local-ai". That should probably just be "local AI". Afterwards, there is "index /settings", which should just be "settings." Then, there is an unlabeled button. I'm guessing this is styled to look like a menu bar, across the top of the window, so it'd be the item on the right side. Now, there's a button below that that says "New Chat^N". I, being a technical user, am pretty sure the "^N" means "Control + N", but almost no one else knows that. So, maybe change that text label. Between that and the Recent Chats menu button are two unlabeled buttons. I'm not sure why a region landmark was used for the recent chats list, but after the chat name "hello" in this case, where I can rename the chat, there is an unlabeled button. The button after the model chooser is unlabeled as well. After the user input in the conversation, there are three unlabeled buttons. After the response, there is a menu button with (oh, that's cool) items to transform the response into bullets, a table, ETC. but that menu button was unlabeled so I had to open it to see what's inside. After that, all other buttons, like for adding instructions to refine this message, are also unlabeled. So, live regions for speaking chat messages and state changes like "loading" or "ready" or whatever (keep them short), and label controls, and you should be good to go. Live regions: https://developer.mozilla.org/en-US/docs/Web/Accessibility/ARIA/ARIA_Live_Regions https://developer.mozilla.org/en-US/docs/Web/Accessibility/A...

SkepticMystic 3y ago

I've found great utility with `llm` https://llm.datasette.io https://llm.datasette.io, a CLI to interact with LLMs. It has plugins for remote and local models.

xyc 3y ago
Good to know. I've learned lots of things from Simon Willison's blog (datasette's author), so can't imagine llm being unuseful.

geniium 3y ago

I am very glad to see that kind of app. Well done!

rkuodys 3y ago

Honest question - can it be used for programming? Or anyone maybe can recommend local-first development LLM which would take in all project (Python / Angular) and write code based on full repo, not only the active window as with Copilot or Jetbrains AI

arzke 3y ago
Have you tried using Copilot's @workspace command in the chat?
_ink_ 3y ago
Check out the continue dev plugin (available for VS Code and Jetbrains). You can attach it to OpenAI or local models and it can consider files in your codebase. It has a @Codebase keyword, but so far I get better results in specifically pointing to the needed files.

surrTurr 3y ago

any plans on supporting ollama integration?

code51 3y ago

Thank you for the work. Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though. ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what it's trying to do.

kvakkefly 3y ago
Dangerously close to the old famous Dropbox comment to the original ShowHN post
ayhoung 3y ago
Not everyone is a dev
- Alifatisk 3y ago
  HN users keep forgetting that
vood 3y ago
Thanks for sharing ChatbotUI. While I'm not an author, I use it extensively and contribute to it. Thanks to the permissive license, I could offer ChatbotUI as a hosted solution with our API keys. https://labs.writingmate.ai https://labs.writingmate.ai.

911e 3y ago

Not a bit of open code while I'm 100% sure they use some that require it. If you"re using AI + Your data without insight on how it's used you're a fool. 2 cents

tartrate 3y ago

> Full Text Search. Blazingly fast search over thousands of messages. Natural language processing has come full circle and just reinvented Ctrl+F. I had to double check that a regular '90s search function was actually the thing being advertised here, and sure enough, there is a gif demonstrating exactly that.

davely 3y ago
Yeah, I think the call out here is specifically because you the ChatGPT interface doesn't have a search feature (on web). Interestingly, on their iOS app, you can search. I often find myself opening the app on my phone if I want to find a previous conversation, even if I'm at my desk.
- antifa 3y ago
  The search feature on ChatGPT for Android only works for a tiny number of recent chats.
Grimblewald 3y ago
I'm a big fan of ctrl+f, but semantic search is a life saver that conventional search simply cannot compare to.
Moldoteck 3y ago
i'm more interested how to perform semantic search over messages efficiently. Like to receive the reference to the og message. Is it creating an llm response with the potential content and how does it find the og message? is it performing tf/idf+cosine search after that or how?
replwoacause 3y ago
Yes but this is missing from most chatbot UIs (ChatGPT, Gemini, Claude, etc. ) so is therefore very useful. Machato has it but it is very laggy.
addandsubtract 3y ago
Ctrl+F only gets you so far. It doesn't allow you to perform semantic searches, for example. If you don't happen to know a unique word (or set of words) to search for, you're out of luck. Just the other day, I was able to find a song by typing the phonetic pronunciation (well, as best I could) into ChatGPT, and it knew which song I was talking about right away. No way a regular search engine would've helped me there.

ggerganov 3y ago

> Thanks to the amazing work of @ggerganov on llama.cpp which made this possible. If there is anything that you wish to exist in an ideal local AI app, I'd love to hear about it. The app looks great! Likewise, if you have any requests or ideas for improving llama.cpp, please don't hesitate to open an issue / discussion in the repo

titaniumtown 3y ago
Wow I've been following your work for a while, incredible stuff! Keep up the hard work, I check llama.cpp's commits and PRs very frequently and always see something interesting in the works (the alternative quantization methods and Flash Attention have been interesting).
petargyurov 3y ago
Did not expect to see the Georgi Gerganov here :) How is GGML going? Поздрави!
- ggerganov 3y ago
  So far is going great! Good community, having fun. Many ideas to explore :-)
xyc 3y ago
Oh wow it's the goat himself, love how your work has democratized AI. Thanks so much for the encouragement. I'm mostly a UI/app engineer, total beginner when it comes to llama.cpp, would love to learn more and help along the way.
duckkg5 3y ago
Nothing to add except that your work is tremendous

jiriro 3y ago

Out of curiosity – how is this app built?:-) There is a demo clip with a vertical scroll bar which does not fade out as it would do in a native mac app:)

rangera 3y ago
Scroll bars don't fade out if you're using a mouse (as opposed to just a trackpad) or if you've set Mac OS Settings > Appearance > Show scroll bars to "Always".
- jiriro 3y ago
  I see! I’ve not used mouse on a mac:-o Anyway the UI looks not mac native. I’m interested what it is:-)
Alifatisk 3y ago
Yeah I am curious what the app is built with. I saw someone mention it's using Electron, so that's a start.
- SushiHippie 3y ago
  Even with a screenshot https://news.ycombinator.com/item?id=39535755 https://news.ycombinator.com/item?id=39535755

zzz999 3y ago

Any censorship? (Can't try MacOS Apps)

famahar 3y ago

Will this work on an M1 Mac Book Air? Looking for an offline solution like this but wary of hardware requirements.

konschubert 3y ago

I want something that starts as a simple manager for my reminders, something that tells me what to do next. And then, as features are being added, grows into a full-blown personal assistant that can book flights for me.

stuckkeys 3y ago

No iPhone app? Assuming it looks to connect to a local server or are you actually downloading the llms local to the device?

domano 3y ago

Hey, i bought it, nice work! A few things: * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Such a chat ui is not usable for me without this feature. * The feedback button does nothing for me, just changes focus to chrome. * The LLaVA model tells me that it can not generate images since it is a text based AI model. My prompts were "Generate an image of ..."

xyc 3y ago
Thank you for the support and the valuable feedback! Sorry about the response time, I haven't expected the incoming volume of requests. * For changing prompt in the middle - I'll take a crack at it this week. It's on top of my post launch list. * Feedback button: Thanks for reporting this. The button was supposed to open default email client to email feedback@recurse.chat * LLaVA model: I'll add more documentation. You are right Llava could not generate images. It can only describe images (similar to GPT-4v). For image generation, it's not supported in the app. While I don't have immediate plans for image generation, check out these projects for local image generation. - https://diffusionbee.com/ https://diffusionbee.com/ - https://github.com/comfyanonymous/ComfyUI https://github.com/comfyanonymous/ComfyUI - https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui
wodow 3y ago
> * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Agreed, but what I would also really like (from this and ChatGPT) would be branching: take a conversation in two different ways from some point and retain the seperate and shared history. I'm not sure what the UI should be. Threads? (like mail or Usenet)
- ItsMattyG 3y ago
  ChatGPT does this. You just click an arrow and it will show you other branches.

bberenberg 3y ago

There are a lot of tools listed in this thread, but I am not seeing the thing I want which is: - Ability to use local and OpenAI models (ideally it has defaults for common local models) - Chat UX - Where I can point it to my JS/TS codebase - It indexes the whole thing including dependencies for RAG. Ideally indexing has some form of awareness of model context length. - I can use it for codegen / debugging. The closest I have found has been aider, but it's python and I get into general python hell every time I try and run it. Would appreciate a suggestion.

ferfumarma 3y ago

Is the haiku example a real Haiku? I think it gives you 4, 7, and 9 syllables in the lines. I bet you can coax it to give you a better example, if you tinker a bit.

howmayiannoyyou 3y ago

Without Apple Shortcuts support I can't pay for this. I get pretty much the same experience from GPT4All. Hoping you add support CLI, Shortcuts or something along those lines.

xyc 3y ago
Thanks for the suggestion! I play with Apple Shortcuts sometimes. It's an exemplary example of how easy end user programming could be. Will keep this in mind.

boringg 3y ago

This looks interesting -- might implement it. I'm curious how to ensure that it is local only?