strangescript

8 ms·

61.
by strangescript 1y ago
The T1000s are going to be chasing Gary down and he is going to look over his shoulder and explain to them they aren't really AGI
62.
by strangescript 1y ago
I am not convinced hallucinations is a solvable problem in a single self contained model. In one hand we approach these things with the idea we are building a real intelligence modeled after our assumptions of our own brain. In the other we
63.
by strangescript 1y ago
"If a machine is consuming and transforming incalculable amounts of training data produced by humans, discussed by humans, and explained by humans. Why would the output not look identical to human reasoning? If I were to photocopy this
64.
by strangescript 1y ago
We haven't reached a peak on scaling/performance, so even if an old model can be commoditized, a new one will be created to take advantage of the newly freed infra. Until we hit a ceiling on scaling, tokens are going to remain exp
65.
by strangescript 1y ago
The problem with the Bitter Lesson is that it doesn't clearly define what is a computational "hack" and what is a genuine architecturally breakthrough. We would be no where without transformers for example.
66.
by strangescript 1y ago
Is the name meant to be a jab at you know who or am I reading too much into it?
67.
by strangescript 1y ago
“It’s only going to get better” "For LLMs to keep improving, we need one of three things: more data, more power or a breakthrough." "Breakthroughs are rare." This is very short sighted. The amount of research and papers
68.
by strangescript 1y ago
If coding agents progress like the predictions, there is no world where many people are not out of jobs. Not just coders, but code related jobs. There is so much infra around humans not writing good code, or not being able to plan well. If
69.
by strangescript 1y ago
I was literally typing band-aid when I scrolled down. Many systems are going to have to come up with better solutions to the problems AI will pose for legacy processes.
70.
by strangescript 1y ago
The diagrams in this article are amazing if you are somewhere in between a novice and expert. Seeing all of the new models laid out next to each other is fantastic.
71.
by strangescript 1y ago
We are the frog in the warm water...
72.
by strangescript 1y ago
who said anything about creating something more intelligent than us, these articles have the air of "why are we wasting our time on this stuff", people like gary marcus link them, meanwhile they get better week over week
73.
by strangescript 1y ago
"You know that really hard test thing that most humans on the planet can't do, or even understand, yeah, LLMs kind of suck at it too" Meanwhile Noam "well aschtually..." I love how people are still betting against A
74.
by strangescript 1y ago
Does valve even leak the game titles you purchase to card processors? Don't they have some plausible deniability here?
75.
by strangescript 1y ago
I feel like this is more about Linux remaining reliable and the other platforms getting worse, rather than Linux getting substantially better. I no longer have a windows machine. If I can't get a game to run on Linux then I don't
76.
by strangescript 1y ago
I mean, thats the point, they aren't the same. Concorde was one dimensional, AI is not.
77.
by strangescript 1y ago
I think the difference between all previous technologies is scope. If you make a super sonic jet that gets people from place A to place B faster for more money, but the target consumer is like "yeah, I don't care that much about t
78.
by strangescript 1y ago
The great thing but terrifying thing about innovation is we rarely select how it plays out. People create great ideas and concepts, but they rarely play out exactly how the initial researchers/inventors expected. Did Apple know we woul
79.
by strangescript 1y ago
better yet, wait 10, let me know how it goes
80.
by strangescript 1y ago
This entire concept hinges on AI not getting better. If you believe AI is going continue to get better at the current ~5-10% a month range, then hand waiving over developer productivity today is about the same thing as writing an article ab
81.
by strangescript 1y ago
A byte tokenized model is naturally 100% multi-lingual in all languages in its data set. There just isn't a lot of reason for teams to spend the extra training time to build that sort of model.
82.
by strangescript 1y ago
If your model is getting confused by python, its a bad model. Python is routinely the best language for all major models.
83.
by strangescript 1y ago
Reading the title and knowing exactly what this is about kind of makes me feel old to be honest.
84.
by strangescript 1y ago
If you work with model architecture and read papers, how could not know there are a flood of new ideas? Only few yield interesting results though. I kind of wonder if libraries like pytorch have hurt experimental development. So many basic
85.
by strangescript 1y ago
Who said I wanted my outcomes to be deterministic. Why is it that the only way we accept programming is for completely deterministic outcomes, when the reality is that is an implementation detail. I am a real user and I am on a general purp
86.
by strangescript 1y ago
I am sure my brain activity is lower when I use a calculator instead of doing math by hand as well. -- Nothing like a 100% accurate statement getting downvotes because people hate AI
87.
by strangescript 1y ago
google was way to obsessed with immediate success during this time, if they had that same mentality now they would have given up on LLMs and now they are in first in most categories
88.
by strangescript 1y ago
So many people on their high horse when Nexus attempted to do collections, as if Nexus Mods was their god given place to post their mods for free and control everything about how they are used. Congratulations! You are going to be so happy
89.
by strangescript 1y ago
What exactly is the alternative? Wish it away? Developers have been automating away jobs for decades, its seems hypocritical to complain about it now.
90.
by strangescript 1y ago
Everyone is still thinking about this problem the wrong way. If you are still running one agent, on one project at a time, yes, its not going to be all that helpful if you are already a fast, solid coder. Run three, run five. Prompt with vo

More ›