lostpharoah

3 ms·

1. 1.▲
   by lostpharoah 4y ago

   I suspect a lot of low-quality content still makes it into the training process and the RLHF layer is specifically designed to improve the quality of the output despite noisy input. i.e. without RLHF, these models would for sure be vulgar,
2. 2.▲
   Ask HN: What does the data engineering behind LLMs look like?

   19 points by lostpharoah 4y ago|5 comments