3 ms·

Free tier provides a lot of training material. Every time you correct ChatGPT on its mistakes you’re giving them knowledge that’s not in any book or website. T

by DenisM 1y ago

Free tier provides a lot of training material. Every time you correct ChatGPT on its mistakes you’re giving them knowledge that’s not in any book or website. Thats a moat, albeit one that is slow to build.

dcre 1y ago
That's interesting, though you have to imagine the data set is very low quality on average and distilling high quality training pairs out of it is very costly.
- DenisM 1y ago
  Hence exponential increase in model training costs. Also hallucinations in the long tail of knowledge.