3 ms·

This line of reasoning implies that Google had models that were equivalent to OpenAI's but chose to keep them behind closed doors. However, upon releasing Bard,

This line of reasoning implies that Google had models that were equivalent to OpenAI's but chose to keep them behind closed doors. However, upon releasing Bard, it was apparent—and continues to be—that it does not match up to OpenAI's offerings. This indicates that the discrepancy is more likely due to the actual capabilities of Google's models, rather than concerns such as legal, PR, safety, resource allocation, or monetization.

ChatGTP 3y ago
As we all know, we don't know what C-4 is trained on. It might be trained on information they didn't have the rights to use (for example). This is why they might be so tight lipped on how it was produced. Google on the other hand, has much much more to loose here, much bigger reputation to protect, and may have built an inferior product that's actually produced in a more legally compliant way. Another example would be Midjourney vs Adobe Firefly, there is no way Firefly makes art as nice as MJ produces. Technically it's good stuff, but it's not as fun to use because I can't generate Pikachu photos with Firefly. People have stated that ChatGPT-4 isn't as good anymore. My personally belief is this is just the shine wearing off what was a novelty. However it may also be OpenAI removing the stuff they shouldn't have used in the first place. Although there are reports the model hasn't changed for some time so who knows. I guess in time we'll find out. Personally I don't really care for either product so much, most of my interactions have been fairly pointless. I think it's just fun to watch these big tech companies try deal with these products they've created. It's amusing as fuck.
- machdiamonds 3y ago
  If Google only used data that isn't copyrighted, they'd probably make a big deal about it, just like Adobe does with their Firefly model. Also, it's not really possible for OpenAI to just take out certain parts from the model without retraining the whole thing. The drop in quality might be due to attempts to make the model work faster through quantization and additional fine-tuning with RLHF to curb unwanted behavior.
  - ChatGTP 3y ago
    So basically, you're of the belief whatever OpenAI has done it's some kind of magic which Google cannot / has not figured out?
    - ChatGTP 3y ago
      I re-read, didn't mean to sound snarky, although it did, just curious if that's what you really believe is going down??
      - machdiamonds 3y ago
        I think Google still has a decent chance of catching up. It's just a bit surprising to see them fall behind in an area they were supposed to be leading, especially since they wrote the paper which started all of this. Also, Anthropic is already kind of close to OpenAI, so I don't think OpenAI has some magic that no one else can figure out. In the future, I predict that these LLMs will become a commodity, and most of the available models will work for most tasks, so people will just choose the cheapest ones.

ChatGTP 3y ago

As we all know, we don't know what C-4 is trained on. It might be trained on information they didn't have the rights to use (for example). This is why they might be so tight lipped on how it was produced. Google on the other hand, has much much more to loose here, much bigger reputation to protect, and may have built an inferior product that's actually produced in a more legally compliant way. Another example would be Midjourney vs Adobe Firefly, there is no way Firefly makes art as nice as MJ produces. Technically it's good stuff, but it's not as fun to use because I can't generate Pikachu photos with Firefly. People have stated that ChatGPT-4 isn't as good anymore. My personally belief is this is just the shine wearing off what was a novelty. However it may also be OpenAI removing the stuff they shouldn't have used in the first place. Although there are reports the model hasn't changed for some time so who knows. I guess in time we'll find out. Personally I don't really care for either product so much, most of my interactions have been fairly pointless. I think it's just fun to watch these big tech companies try deal with these products they've created. It's amusing as fuck.

machdiamonds 3y ago
If Google only used data that isn't copyrighted, they'd probably make a big deal about it, just like Adobe does with their Firefly model. Also, it's not really possible for OpenAI to just take out certain parts from the model without retraining the whole thing. The drop in quality might be due to attempts to make the model work faster through quantization and additional fine-tuning with RLHF to curb unwanted behavior.
- ChatGTP 3y ago
  So basically, you're of the belief whatever OpenAI has done it's some kind of magic which Google cannot / has not figured out?
  - ChatGTP 3y ago
    I re-read, didn't mean to sound snarky, although it did, just curious if that's what you really believe is going down??
    - machdiamonds 3y ago
      I think Google still has a decent chance of catching up. It's just a bit surprising to see them fall behind in an area they were supposed to be leading, especially since they wrote the paper which started all of this. Also, Anthropic is already kind of close to OpenAI, so I don't think OpenAI has some magic that no one else can figure out. In the future, I predict that these LLMs will become a commodity, and most of the available models will work for most tasks, so people will just choose the cheapest ones.