3 ms·
In this case "powerful" means faster chips. It's not clear that this translates into 1,000,000 smarter given that current AI might end up bottlenecked on availa
by fidgewidge 4y ago
In this case "powerful" means faster chips. It's not clear that this translates into 1,000,000 smarter given that current AI might end up bottlenecked on availability of text and information to train it on. I guess if you could speed things up by a million-fold though, you could have way bigger context windows and you could potentially set a LLM talking to itself as it explores a problem through web search, writing and running programs, etc. Exciting times.
- pixl97 4y agoIf I had to make a guess, I would think that text based LLMs will run into that wall sooner than later. But the rapid increase in compute availability wouldn't limit us to text either. Also imagine the models working on image input, sound data, video, temperature, touch, and whatever other inputs you could encode and present to them. This brings it more in line with the human experience of inputs.