4 ms·

Thinking about high-quality human data

• deleted 3y ago
  [deleted]
• nerpderp82 3y ago
  For those that don't know, Lilian Weng wrote one of the best "prompt engineering" howtos on the planet. It is beautiful in its succinct compactness. https://lilianweng.github.io/posts/2023-03-15-prompt-engineering/ https://lilianweng.github.io/posts/2023-03-15-prompt-enginee...
  • 6gvONxR4sf7o 3y ago
    More than that, she writes great reviews of all sorts of ML stuff. They're about as good as it gets for getting started on whatever topic.
  • dang 3y ago
    Discussed here: Prompt Engineering: Steer a large pretrained language model to do what you want - https://news.ycombinator.com/item?id=35227358 https://news.ycombinator.com/item?id=35227358 - March 2023 (49 comments)
• deleted 3y ago
  [deleted]
• visarga 3y ago
  > The NCV (Noisy Cross-Validation) method (Chen et al. 2019) divides the dataset into half at random, and then identifies data samples as “clean” if its label matches the predicted label provided by the model that is only trained on the other half of the dataset. I was doing this trick in 2018, didn't write anything up. If you repeat this process a few times, it provides more fine-grained example difficulty signal so you can validate only the hard part by hand, or just skip it.