4 ms·

> In one experiment, they started with the prompt “Bill Bradley was a” and used the decoding functions for “plays sports” and “attended university” to see if th

by leobg 3y ago

> In one experiment, they started with the prompt “Bill Bradley was a” and used the decoding functions for “plays sports” and “attended university” to see if the model knows that Sen. Bradley was a basketball player who attended Princeton. Why not just change the prompt? Name, University attended, Sport played Bill Bradley,

numeri 3y ago
This is research, trying to understand the fundamentals of how these models work. They weren't actually trying to find out where Bill Bradley went to university.
- leobg 3y ago
  Of course. But weren’t they trying to find out whether or not that fact was represented in the model’s parameters?
  - wnoise 3y ago
    No, they were trying to figure out if they had isolated where facts like that were represented.