3 ms·

It uses a different engine, so this is as related to ChatGPT as a Toyota Corolla is related to a BMW car. This is an efficient and open-source chatbot, which is

It uses a different engine, so this is as related to ChatGPT as a Toyota Corolla is related to a BMW car. This is an efficient and open-source chatbot, which is very good news, but the authors just wrote a clickbait title and they know it.

f_devd 4y ago
> Toyota Corolla is related to a BMW car. The analogy is somewhat accurate, but also moot, since within the ML community "ChatGPT" can be used either as the product or the method (more specifically called RLHF) somewhat interchangeably. It's more like Google/Googling, where the largest/most popular provider becomes the defacto way to refer to a method. As someone who develops DL models, the title seems quite apt.
basch 4y ago
In formal analogies, : is pronounced "is to" and :: is pronounced "as". The purpose here is to use the relationship from a known, to describe the relationship between a partial known. ChatGPT is to GPT3 as ChatLLaMa is to LLaMa. It uses the relationship between ChatGPT and GPT3 to extrapolate a relationship between an unknown and LLaMa. see Analogies.pdf https://resources.finalsite.net/images/v1584287027/brockton/ctbakxiw8qmvpa8nmgox/Analogies.pdf https://resources.finalsite.net/images/v1584287027/brockton/... Corolla:Toyota::3-Series:BMW. If you had heard of a Corolla, Toyota, and BMW, but not a 3-Series, you now roughly know that a 3-Series is BMWs equivalent to a Corolla.
- levesque 4y ago
  I think I prefer the other commenter's point, referring to ChatGPT as a known learning paradigm for chatbots. But thanks for the little crash course on analogies ;)
  - basch 4y ago
    Isn't that consistent with, and the same as, my original comment? ChatGPT:GPT3::ChatLLaMa:LLaMa::Chatbot-through-RLHF:LLM aka ChatGPT is a known chatbot implementation, and GPT3 and LLaMa are known LLMs.
    - levesque 4y ago
      Yes and no. You wouldn't say GPT to mean large language models or autoregressive language models. I would've thought the same to be true for ChatGPT instead of Chatbots with RL from human feedback (RLHF), perhaps the field is moving towards adopting ChatGPT as a paradigm name. Note that the title doesn't say a ChatGPT-like model based on LLaMa, it says outright opensource implementation of ChatGPT.
      - basch 4y ago
        > You wouldn't say GPT to mean large language models or autoregressive language models. In the analogy, that’s exactly what you are saying. Identical to Toyota and BMW meaning “the make of the car.” Maybe reimplementation is a more precise word, a black box re-engineering/cloning. In this case I inferred it by knowing it was a different LLM underneath, and that this group didn’t have access to the chatgpt source code.

f_devd 4y ago

> Toyota Corolla is related to a BMW car. The analogy is somewhat accurate, but also moot, since within the ML community "ChatGPT" can be used either as the product or the method (more specifically called RLHF) somewhat interchangeably. It's more like Google/Googling, where the largest/most popular provider becomes the defacto way to refer to a method. As someone who develops DL models, the title seems quite apt.

basch 4y ago

In formal analogies, : is pronounced "is to" and :: is pronounced "as". The purpose here is to use the relationship from a known, to describe the relationship between a partial known. ChatGPT is to GPT3 as ChatLLaMa is to LLaMa. It uses the relationship between ChatGPT and GPT3 to extrapolate a relationship between an unknown and LLaMa. see Analogies.pdf https://resources.finalsite.net/images/v1584287027/brockton/ctbakxiw8qmvpa8nmgox/Analogies.pdf https://resources.finalsite.net/images/v1584287027/brockton/... Corolla:Toyota::3-Series:BMW. If you had heard of a Corolla, Toyota, and BMW, but not a 3-Series, you now roughly know that a 3-Series is BMWs equivalent to a Corolla.

levesque 4y ago
I think I prefer the other commenter's point, referring to ChatGPT as a known learning paradigm for chatbots. But thanks for the little crash course on analogies ;)
- basch 4y ago
  Isn't that consistent with, and the same as, my original comment? ChatGPT:GPT3::ChatLLaMa:LLaMa::Chatbot-through-RLHF:LLM aka ChatGPT is a known chatbot implementation, and GPT3 and LLaMa are known LLMs.
  - levesque 4y ago
    Yes and no. You wouldn't say GPT to mean large language models or autoregressive language models. I would've thought the same to be true for ChatGPT instead of Chatbots with RL from human feedback (RLHF), perhaps the field is moving towards adopting ChatGPT as a paradigm name. Note that the title doesn't say a ChatGPT-like model based on LLaMa, it says outright opensource implementation of ChatGPT.
    - basch 4y ago
      > You wouldn't say GPT to mean large language models or autoregressive language models. In the analogy, that’s exactly what you are saying. Identical to Toyota and BMW meaning “the make of the car.” Maybe reimplementation is a more precise word, a black box re-engineering/cloning. In this case I inferred it by knowing it was a different LLM underneath, and that this group didn’t have access to the chatgpt source code.