5 ms·

Have you tried anything similar to this? I am wondering if it would just be possible with GPT in Slack. I read something from OpenAI about how they built GPT fo

by chw9e 3y ago

Have you tried anything similar to this? I am wondering if it would just be possible with GPT in Slack. I read something from OpenAI about how they built GPT for Slack, but I don't know if it captures previous chat context or not. I think it would be cool too to be able to give access to github or google docs/notion. I think it would be a more efficient and fun way to collaborate than using Slack, especially if GPT could get edit access to documents and code.

catlover76 3y ago
I have not tried anything similar to it, it just occurred to me a couple months ago that it might be useful, and your post reminded me of the idea. What I had in mind was just a simple "multiple users chatting with LLM" standalone thing.
- chw9e 3y ago
  Is your use case team collaboration and productivity or just for fun? I saw some people have built stuff like FB Messenger bots using GPT. I think one problem with the idea is that the cost is very high unless you do some optimization work. $0.03/1k tokens for GPT-4, and if you use the full 8k context window then assume each message costs roughly $0.24. At 20 message per day, OpenAI costs would be $5/day, and that is like $150/month. Compare to ChatGPT at $20/month with unlimited messages and it's pretty hard to see how this can monetize. Either OpenAI is baking in a ton of margin to the GPT API or they are selling ChatGPT at a huge loss. I don't know if there's any feature you can add on top that makes it worth 6-7x just using ChatGPT on its own. Maybe you can optimize by using some other models or using less of the context window. But even if you cut costs by 50% you are still paying OpenAI $70-$80/month/user and I don't know if anyone is willing to pay that vs just using ChatGPT. I saw there is this Team-GPT app: https://team-gpt.com/ https://team-gpt.com/. They charge some money and you bring your own GPT token. So it looks cheap but I guess it's still super expensive, you're just paying OpenAI directly.

by chw9e 3y ago

catlover76 3y ago

I have not tried anything similar to it, it just occurred to me a couple months ago that it might be useful, and your post reminded me of the idea. What I had in mind was just a simple "multiple users chatting with LLM" standalone thing.

chw9e 3y ago
Is your use case team collaboration and productivity or just for fun? I saw some people have built stuff like FB Messenger bots using GPT. I think one problem with the idea is that the cost is very high unless you do some optimization work. $0.03/1k tokens for GPT-4, and if you use the full 8k context window then assume each message costs roughly $0.24. At 20 message per day, OpenAI costs would be $5/day, and that is like $150/month. Compare to ChatGPT at $20/month with unlimited messages and it's pretty hard to see how this can monetize. Either OpenAI is baking in a ton of margin to the GPT API or they are selling ChatGPT at a huge loss. I don't know if there's any feature you can add on top that makes it worth 6-7x just using ChatGPT on its own. Maybe you can optimize by using some other models or using less of the context window. But even if you cut costs by 50% you are still paying OpenAI $70-$80/month/user and I don't know if anyone is willing to pay that vs just using ChatGPT. I saw there is this Team-GPT app: https://team-gpt.com/ https://team-gpt.com/. They charge some money and you bring your own GPT token. So it looks cheap but I guess it's still super expensive, you're just paying OpenAI directly.