4 ms·
Not sure what their motivation was to use the word "stealing" here - they are obtaining the output layer weights (mapping from hidden dimension to output), but
by HarHarVeryFunny 3y ago
Not sure what their motivation was to use the word "stealing" here - they are obtaining the output layer weights (mapping from hidden dimension to output), but it seems the hidden dimension size is the most interesting thing here. They could have called it probing rather than stealing.
- HumblyTossed 3y ago> Not sure what their motivation was to use the word "stealing" here Maybe, simply, to get peoples' attention?