3 ms·
I think we do know how they work, no? We give a model some input, this travels through the big neural net of probabilities (gotten with training) and then arriv
by kreetx 10mo ago
I think we do know how they work, no? We give a model some input, this travels through the big neural net of probabilities (gotten with training) and then arrives at a result.
Sure, you don't know what the exact constellation of a trained model will be upfront. But similarly you don't know what, e.g, the average age of some group of people is until you compute it.
- cubefox 10mo agoIf it solves a problem, we generally don't know how it did it. We can't just look at its billions of weights and read what they did. They are incomprehensible to us. This is very different from GOFAI, which is just a piece of software whose code can be read and understood.
- kreetx 10mo agoAny statistical model does this.
- cubefox 10mo agoStatistical models have just a few parameters, machine learning models have billions. Possibly more than a trillion.
- kreetx 10mo agoThe number can be anything, is there a number at which "we don't know" starts? The model's parameters are in your RAM, you insert the prompt, it runs through the model and gives you a result. I'm sure if you spend a bit of time, you could add some software scaffolding around the process to show you each step of the way. How is this different from a statistical model where you "do know"?