2 ms·

All the big guys are hiring domain experts - serious brains, phd level, in some cases - to build bespoke train and test data for their models. As long as Jense

• Wheatman 2y ago
  Interestingly enough, the new "Orion" model by OpenAI doesnt outperform, and even sometimes underperforms in programing tasks, when compared to GPT-4. There is an interesing discussion about it here:https://news.ycombinator.com/item?id=42104964 https://news.ycombinator.com/item?id=42104964.
• tucnak 2y ago
  > All the big guys are hiring domain experts - serious brains, phd level, in some cases I don't know where this myth had originated, and perhaps it was true at least at some point, but you just have to consider that all the recent major advances in datasets had to do with _unsupervised_ reward models, synthetic, generational datasets, and new advanced alignment methods. The big labs _are_ hiring serious PhD level researchers, and most of these are physicists, Bayesians of many kind and breed, not "domain experts." However, perception matters a lot these days; some labs, I won't point, but OpenAI is probably the biggest offender, simply cannot control themselves. The fact of the matter is they LOVE including the public evals in their finetuning, as it makes them appear stronger in the "benchmarks."
• kwlranb 2y ago
  The PhD folks will steal from Stackoverflow and leetcode solutions. Just another laundering buffer. Hardly any PhD has the patience or skill for that matter to code robust solutions from scratch. Just look at PhD code in the wild.