2 ms·
This is an idiotic take "I call it a "bullshit generator" because it generates output "with indifference to the truth"." yeah, no. the point of post-training
by davidguetta 10mo ago
This is an idiotic take
"I call it a "bullshit generator" because it generates output "with indifference to the truth"."
yeah, no. the point of post-training with RL is precisely to get the truth on many tasks. Many of the answers in post training are judged on whether they are true or not, not just "RLHF / human preference".
Also it's not like human are perfectly commited to truth always itself and we don't question their overall innate "intelligence" sense.
Stallman just doesn't know what post-training is