4 ms·

Best teacher of transformer model is ChatGPT itself

• gnicholas 3y ago
  One thing I wonder about is where it gets its data about itself from. Did they feed it a bunch of accurate information about itself?
  • quickthrower2 3y ago
    I reckon they did
    • gnicholas 3y ago
      Quite possible! But given how ChatGPT hallucinates, and my general lack of knowledge about LLMs in general and ChatGPT in particular, I would be hesitant to take what it says at face value. I'm especially hesitant to trust anything it says about itself in particular, since much of its specifics are not publicly documented and are essentially unverifiable. I wish there were some way for it to communicate that certain responses about itself were more or less hardcoded.