3 ms·
>The Hollywood trope "even the guys who built it don't know how it works" isn't real. How is that not real? Have you ever tried understanding what the weights
by sebzim4500 4y ago
>The Hollywood trope "even the guys who built it don't know how it works" isn't real.
How is that not real? Have you ever tried understanding what the weights of a NN are doing? With networks with 20 parameters you might have a chance. Trying to understand which bits of the GPT-3 network do what would be an exercise in futility.
- robswc 4y agoI totally get what you're saying... but I also feel like this is akin to knowing how to drive a car without knowing the details of the engine. Sure, its a black box but we can operate on a layer that abstracts all those details away from us. I just feel its a far cry from the Hollywood trope of "I have no idea how it works!" ... now, tbh, I often say "wtf are you doing" which I imagine would be worse to hear when talking about a model with real world impact.