3 ms·
Scientists are trying to unravel the mystery behind modern AI
- rkagerer 2y agoUntil about a decade ago, humans created software by writing lines of code. I must have blinked and missed the new way.
- dayjaby 2y agoThe preceeding sentence is also incredibly stupid: > The field of computer science, particularly on the software side, has historically involved more “engineering” than “science.” Let's ignore the fact they confuse the words "computer science" and "software engineering". If anything, the same or worse can be stated about AI: The field of AI, or how normal people use AI, has historically involved more "prompt engineering" than "prompt science", or any science whatsoever.
- xg15 2y agoThen have fun trying to debug an LLM and realising that not only are there billions of unlabeled variables (weights and activations) but that in fact no one knows the specific purposes of those variables, not even the people who wrote the code and trained the model.
- jrvieira 2y agoThis reads like a highschool assignment.
- alok-g 2y agoI bet it would be the other way round. We can more easily probe into the AI models than the brain and get insights into what could be happening inside the brain.