4 ms·

ATM ChatGPT is tedious. I think there are two things we can take from discord/fb messenger/slack to improve it: 1) ChatGPT and this thing needs threads. I wan

by voz_ 3y ago

ATM ChatGPT is tedious. I think there are two things we can take from discord/fb messenger/slack to improve it: 1) ChatGPT and this thing needs threads. I want to be able to take a conversation and fork it - with separate conversational memories/context after a point of forking. I want to be able to take a message, go "reply" to it, and be able to do that as many times as I want, per message, with each reply being treated independently of all other replies. It is insanely useful to be able to take a conversation / debugging session / etc into a different direction experimentally without risking the entire state of the conversation thus far. 2) I want to be able to react to the messages. Thumbs up / down, agree/ disagree, etc - a small set of reactions to drive behavior would be huge, and would cut down on a lot of back and forth verbosity that plagues these.

generalizations 3y ago
ChatGPT (at least, the paid version) does do this. But the UI doesn't emphasize it very much, and there's no way to visualize the tree of conversations.
- voz_ 3y ago
  Where does it do this?
  - zora_goron 3y ago
    You can edit a message you’ve already sent by hovering over it and clicking the “edit” icon, which will create a new “fork” in the conversation. You can toggle between forks as needed too.
    - robbiep 3y ago
      I dont think you can jump back though, right? If you change a previous prompt, you’re just resetting to that point and creating a new thread at the expense of the old one? I use this feature but have coke to the conclusion this is how it works. Have you seen differently?
      - zora_goron 3y ago
        Once you've changed a prompt, a pair of arrows show up to the left of the prompt allowing you to toggle between the new and old prompts!
  - Jarwain 3y ago
    There are thumbs up and thumbs down to the right of the response, next to the clipboard. If you hover over your message, an edit button appears. Editing your message fork the conversation, and creates a pagination thing to the left of the user icon.
    - voz_ 3y ago
      Oh, sorry, this falls short of what I was asking for: For the thumbs, this does not seem to change the conversation in any way - ChatGPT does not react. For editing (this is new to me, so TIL, ty!) - it seems to share memory across threads in a few naive tests I just did, so almost there, but not entirely.
jumploops 3y ago
ChatGPT allows you to do this, using the edit prompt and arrow buttons to switch between chat “trees” With that said, I was frustrated with this enough to build my own tool that allows you to branch/fork any conversation into an entirely new chat (“seeding”). Overtime we’ve added agents, multiplayer, memory, document upload etc. but the most used feature is still the branching/seeding concept. Happy to share more details if curious!
- digdugdirk 3y ago
  I'd absolutely be interested to hear more about the tool you're referring to! How do you structure the memory for your chats? Is that a separate feature from the document upload?
  - jumploops 3y ago
    Great question! We segment memory based on "bud" - essentially an agent that remembers data across conversations. When you upload a document, it gets added to the same vector store, allowing each bud to remember things over time. To be candid, remembering every message in a conversation isn't actually that useful, so by default we don't (search is an exception), and instead rely on a method that extracts the "novel" information for use later. Happy to set you up with an account, email in profile.
- dennisy 3y ago
  Yeah please share!!
- TeMPOraL 3y ago
  Personally, I'm primarily using TypingMind UI (via API). To my great surprise, it seems that at some point, the author removed this feature from the UI. It's their one decision I just can't understand. Unfortunately, I haven't found a better UI replacement yet. ChatGPT on OpenAI doesn't cut it - that app is, for some reason, way too slow and heavy for my Firefox, both on my laptop and my phone. As for GP's request in general: I fear this is unfortunately the blind spot of communication tools design showing up again. With ChatGPT, it's important more so than ever, to recognize that a prolonged discussion will naturally fit a DAG. Not just a tree, but a directed acyclic graph. (Tree is what you get when you want to branch out. DAG is what you get when you then want to merge branches back, or generally reference multiple parallel threads in one response.) EDIT: This took me by surprise - someone actually did a tree interface for ChatGPT! See: https://github.com/jumang4423/treed-gpt4 https://github.com/jumang4423/treed-gpt4 Discovered via: https://news.ycombinator.com/item?id=35909273 https://news.ycombinator.com/item?id=35909273 (thanks 'itsuka!)

by voz_ 3y ago

generalizations 3y ago

ChatGPT (at least, the paid version) does do this. But the UI doesn't emphasize it very much, and there's no way to visualize the tree of conversations.

voz_ 3y ago
Where does it do this?
- zora_goron 3y ago
  You can edit a message you’ve already sent by hovering over it and clicking the “edit” icon, which will create a new “fork” in the conversation. You can toggle between forks as needed too.
  - robbiep 3y ago
    I dont think you can jump back though, right? If you change a previous prompt, you’re just resetting to that point and creating a new thread at the expense of the old one? I use this feature but have coke to the conclusion this is how it works. Have you seen differently?
    - zora_goron 3y ago
      Once you've changed a prompt, a pair of arrows show up to the left of the prompt allowing you to toggle between the new and old prompts!
- Jarwain 3y ago
  There are thumbs up and thumbs down to the right of the response, next to the clipboard. If you hover over your message, an edit button appears. Editing your message fork the conversation, and creates a pagination thing to the left of the user icon.
  - voz_ 3y ago
    Oh, sorry, this falls short of what I was asking for: For the thumbs, this does not seem to change the conversation in any way - ChatGPT does not react. For editing (this is new to me, so TIL, ty!) - it seems to share memory across threads in a few naive tests I just did, so almost there, but not entirely.

jumploops 3y ago

ChatGPT allows you to do this, using the edit prompt and arrow buttons to switch between chat “trees” With that said, I was frustrated with this enough to build my own tool that allows you to branch/fork any conversation into an entirely new chat (“seeding”). Overtime we’ve added agents, multiplayer, memory, document upload etc. but the most used feature is still the branching/seeding concept. Happy to share more details if curious!

digdugdirk 3y ago
I'd absolutely be interested to hear more about the tool you're referring to! How do you structure the memory for your chats? Is that a separate feature from the document upload?
- jumploops 3y ago
  Great question! We segment memory based on "bud" - essentially an agent that remembers data across conversations. When you upload a document, it gets added to the same vector store, allowing each bud to remember things over time. To be candid, remembering every message in a conversation isn't actually that useful, so by default we don't (search is an exception), and instead rely on a method that extracts the "novel" information for use later. Happy to set you up with an account, email in profile.
dennisy 3y ago
Yeah please share!!
TeMPOraL 3y ago
Personally, I'm primarily using TypingMind UI (via API). To my great surprise, it seems that at some point, the author removed this feature from the UI. It's their one decision I just can't understand. Unfortunately, I haven't found a better UI replacement yet. ChatGPT on OpenAI doesn't cut it - that app is, for some reason, way too slow and heavy for my Firefox, both on my laptop and my phone. As for GP's request in general: I fear this is unfortunately the blind spot of communication tools design showing up again. With ChatGPT, it's important more so than ever, to recognize that a prolonged discussion will naturally fit a DAG. Not just a tree, but a directed acyclic graph. (Tree is what you get when you want to branch out. DAG is what you get when you then want to merge branches back, or generally reference multiple parallel threads in one response.) EDIT: This took me by surprise - someone actually did a tree interface for ChatGPT! See: https://github.com/jumang4423/treed-gpt4 https://github.com/jumang4423/treed-gpt4 Discovered via: https://news.ycombinator.com/item?id=35909273 https://news.ycombinator.com/item?id=35909273 (thanks 'itsuka!)