3 ms·
The "predict the next word" to a current llm is at the same level as a "transistor" (or gate) is to a modern cpu. I don't understand llms enough to expand on th
by callmeal 8mo ago
The "predict the next word" to a current llm is at the same level as a "transistor" (or gate) is to a modern cpu. I don't understand llms enough to expand on that comparison, but I can see how having layers above that feed the layers below to "predict the next word" and use the output to modify the input leading to what we see today. It is turtles all the way down.
- brookst 8mo agoIt’s a good comparison. It’s about abstraction and layers. Modern LLMs aren’t just models, they’re all the infrastructure around promoting and context management and mixtures of experts. The next-word bit may be slightly higher than an individual transistor, possibly functional units.
- echelon 8mo agoHumans are future predictors. Our vision systems, our mental models of our careers. People that predict the future tend to do well financially. Now the machines are getting better than we are. It's exciting and a little bit terrifying. We were polymers that evolved intelligence. Now the sand is becoming smart.
- qsera 8mo ago>Now the machines are getting better than we are Then AI companies should stop looking for investors and instead play stock markets with all that predictive powers!
- echelon 8mo agoThe real money is in using the models to build utility and money-making companies. You're removed from orders of magnitude in upside potential if you have to wait for the public markets.
- qsera 8mo ago> money-making companies You mean, money sucking companies, right? >You're removed from orders of magnitude in upside potential if you have to wait for the public markets. because that won't work. That is why!
- echelon 8mo ago> You mean, money sucking companies, right? Is that what you (and all people) are in your job function? A money suck? Do you ever buy anything for food, shelter, and clothing? Do you have hobbies? Capitalism means we don't have to all be hunter-gatherers, and I'm pretty keen on that trade. > because that won't work. That is why! This is the forum for a venture capital firm. A lot of the folks here build things with the intention of creating value and getting compensated for that value creation. Other valid options are sitting at home and playing video games, reading a book, or posting on HN. I like working on problems where I'm the customer and where I would buy the product if it existed. Turns out, there tend to be other people who would buy my software too.
- qsera 8mo agoI get paid for what I do. Not for what I promise to do.
- ejolto 8mo agoThere is a big difference, because I understand how those transistors produce a picture on a screen, I don’t understand how LLMs do what they do. The difference is so big that the comparison is useless.
- jcul 8mo agoI understand how transistors work too, and how they can result in a picture on a screen. But I think most people outside the software / electronics areas don't and to them it's just magic.