Very insightful to have a number from him here: > LLMs are trained on much more than the whole Internet -- they also consume handcrafted answers produced by ar

Very insightful to have a number from him here: > LLMs are trained on much more than the whole Internet -- they also consume handcrafted answers produced by armies of highly qualified data annotators (often domain experts). Today approximately 20,000 people are employed full-time to produce training data for LLMs.