3 ms·

OK, fair enough. Please give me an example of a customer facing chatbot that Llama 2 (and unbearable to use) and GPT 4 customer facing chatbot that is a joy to

OK, fair enough. Please give me an example of a customer facing chatbot that Llama 2 (and unbearable to use) and GPT 4 customer facing chatbot that is a joy to use. I think at the end of the day, you still have customers dreading such interactions.

jmorgan 3y ago
It's early, and this definitely isn't customer facing in the traditional sense, but a team member of mine set up a Discord bot running Llama 2 70B on a Mac studio and we've been quite impressed by its responses to folks who test it. IIRC chat bots are central the vision Facebook has with LLMs (e.g. every instagram account has a personal chat bot), so I would expect the Llama models to get increasingly better at this task. That said the 7B and 13B models definitely don't quite seem ready yet for production customer interaction :-)
- qup 3y ago
  > (e.g. every instagram account has a personal chat bot) That made me think of the Black Mirror episode Joan is Awful, where every human gets their life turned into a series for the company to own and promote. Kinda like instagram content.
dandiep 3y ago
Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1] Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning. Maybe customers don’t enjoy chat bots for customer support, but there are a million other uses for these models. I, for example, LOVE github copilot. 1. https://squidgies.app https://squidgies.app
- moneywoes 3y ago
  Is it cost prohibitive
- borissk 3y ago
  Cool app. Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.
  - dandiep 3y ago
    Costs really aren’t a concern compared to speed of development and quality.
    - borissk 3y ago
      A lot of people who were using say Google Maps in their apps thought the same thing, until Google drastically increased the prices...

jmorgan 3y ago

It's early, and this definitely isn't customer facing in the traditional sense, but a team member of mine set up a Discord bot running Llama 2 70B on a Mac studio and we've been quite impressed by its responses to folks who test it. IIRC chat bots are central the vision Facebook has with LLMs (e.g. every instagram account has a personal chat bot), so I would expect the Llama models to get increasingly better at this task. That said the 7B and 13B models definitely don't quite seem ready yet for production customer interaction :-)

qup 3y ago
> (e.g. every instagram account has a personal chat bot) That made me think of the Black Mirror episode Joan is Awful, where every human gets their life turned into a series for the company to own and promote. Kinda like instagram content.

dandiep 3y ago

Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1] Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning. Maybe customers don’t enjoy chat bots for customer support, but there are a million other uses for these models. I, for example, LOVE github copilot. 1. https://squidgies.app https://squidgies.app

moneywoes 3y ago
Is it cost prohibitive
borissk 3y ago
Cool app. Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.
- dandiep 3y ago
  Costs really aren’t a concern compared to speed of development and quality.
  - borissk 3y ago
    A lot of people who were using say Google Maps in their apps thought the same thing, until Google drastically increased the prices...