3 ms·
Do you know how an LLM works? Can you describe it?
by irishcoffee 8mo ago
Do you know how an LLM works? Can you describe it?
- nomel 8mo agoSorry, what do current LLM architectures have to do with this? It should be extremely clear to you that current LLM don't fit this definition. If they did, we wouldn't be having this conversation!!!!
- esafak 8mo agoDo you know how the human brain works? That science is still in its infancy but that's not stopped us.
- godelski 8mo ago> Do you know how the human brain works? To what degree of accuracy? Depending on how you answer I might answer yes but I might also answer no.
- irishcoffee 8mo agoHere is a run-down of how an LLM works: https://en.wikipedia.org/wiki/Large_language_model https://en.wikipedia.org/wiki/Large_language_model > Do you know how the human brain works? That science is still in its infancy but that's not stopped us. Stopped us from doing what exactly?
- nomel 8mo agoI think a charitable interpretation of their comment is that it hasn't stopped us from practical, fruitful, use. We didn't need an understanding of how it worked, or even a word for intelligence, let alone a definition of it, to get good practical results.
- irishcoffee 8mo agoIt’s a statistical gradient descent prediction machine. I never said it wasn’t useful. It absolutely isn’t smart.
- nomel 8mo agoWhat is "it" you're referring to here? Nobody is talking about current LLM. And, we don't know if gradient decent will be involved, since the systems don't exist yet. Maybe it all be some runtime gradient decent. If there's an optimization problem involved in any part of the process, and numbers are involved, there's a near guarantee it will include gradient decent.