2 ms·
Thanks. This sounds compelling. I’ll look into this further for the details.
by Waterluvian 4y ago
Thanks. This sounds compelling. I’ll look into this further for the details.
- bko 4y agoI found the transcript. It starts around here: > Scott Aaronson: Exactly. In fact, we have a pseudorandom function that maps the N-gram to, let’s say, a real number from zero to one. Let’s say we call that real number ri for each possible choice i of the next token. And then let’s say that GPT has told us that the ith token should be chosen with probability pi. https://axrp.net/episode/2023/04/11/episode-20-reform-ai-alignment-scott-aaronson.html https://axrp.net/episode/2023/04/11/episode-20-reform-ai-ali...