4 ms·
I thought you were going to say that now we're back to bigger-than-room sized computers that cost many millions just to perform the same tasks we could 40 years
by 8n4vidtmkvmk 2y ago
I thought you were going to say that now we're back to bigger-than-room sized computers that cost many millions just to perform the same tasks we could 40 years ago.
I of course mean we're using these LLMs for a lot of tasks that they're inappropriate for, and a clever manually coded algorithm could do better and much more efficiently.
- arthurcolle 2y agojust ask the LLM to solve enough problems (even new problems), cache the best, do inference time compute for the rest, figure out the best/ fastest implementations, and boom, you have new training data for future AIs
- owenpalmer 2y ago> cache the best How do you quantify that?
- martinkallstrom 2y ago"Assume the role of an expert in cache invalidation..."
- DyslexicAtheist 2y ago"one does not just assume", "because the hardest problems in Tech are Johnny Cash invalidations" --Lao Tzi
- Terr_ 2y ago> "Those who invalidate caches know nothing; Those who know retain data." These words, as I am told, were spoken by Lao Tzi. If we are to believe that Lao Tzi was himself one who knew, why did he erase /var/tmp to make space for his project? -- Poem by Cybernetic Bai Juyi, "The Philosopher [of Caching]"
- pavlov 2y ago“Assume the role of an expert in naming things. You know, a… what do they call those people again… there must be a name for it”
- arthurcolle 2y agohowever you want
- adwn 2y ago> and a clever manually coded algorithm could do better and much more efficiently. Sure, but how long would it take to implement this algorithm, and would that be worth it for one-off cases? Just today I asked Claude to create a jq query that looks for objects with a certain value for one field, but which lack a certain other field. I could have spent a long time trying to make sense of jq's man page, but instead I spent 30 seconds writing a short description of what I'm looking for in natural language, and the AI returned the correct jq invocation within seconds.
- freehorse 2y agoI don’t think this is a bad use. A bad use would be to give Claude the dataset and ask it to tell you which elements have that value.
- adwn 2y agoHa, I tried that before. However, the file was too large for its context window, so it only seemed to analyze the first part and gave a wrong result.
- globalise83 2y agoClaude answers a lot of its questions by first writing and then running code to generate the results. Its only limitation is the access to databases and size of context window, both of which will be radically improved over the next 5 years.
- globalise83 2y agoThe LLMs are now writing their own algorithms to answer questions. Not long before they can design a more efficient algorithm to complete any feasible computational task, in a millionth of the time needed by the best human.
- bayindirh 2y agoLLMs are probabilistic string blenders pulling pieces up from their training set, which unfortunately comes from us, humans. The superset of the LLM knowledge pool is human knowledge. They can't go beyond the boundaries of their training set. I'll not go into how humans have other processes which can alter their and collective human knowledge, but the rabbit hole starts with "emotions, opposable thumbs, language, communication and other senses".
- ogogmad 2y ago> They can't go beyond the boundaries of their training set. TFA says they just did. That's what the ARC-AGI benchmark was supposed to test.
- gf000 2y ago> The LLMs are now writing their own algorithms to answer questions Writing a python script, because it can't do math or any form of more complex reasoning is not what I would call "own algorithm". It's at most application of existing ones/calling APIs.