ambrozk

7 ms·

31.
by ambrozk 3y ago
That piece reports that the note in question was not taken down by a central authority in Twitter, and was instead voted down. You gotta read the correction at the bottom.
32.
by ambrozk 3y ago
This is totally wrong. Fine-tuning techniques were a prerequisite for turning academically impressive but boring and useless models into useful, compelling user products like ChatGPT. Fine-tuning complements fundamental model improvements -
33.
by ambrozk 3y ago
This isn't true. In fact, it's the reverse of true. If you think a bit more carefully about your argument, you'll realize that you've asserted that the single most revolutionary advance of modern deep networks (i.e. netw
34.
by ambrozk 3y ago
It may be rational and it may be irrational. All I'm saying is I want to see an argument. My impression of the AI space generally is that there are many, many obvious ideas which are simply waiting to be picked up off the ground and
35.
by ambrozk 3y ago
If the most intelligent machines ever observed in the universe do not count as "intelligent," then we have a semantic, and not a substantive difference of opinion.
36.
by ambrozk 3y ago
To me, if artificial intelligence means anything, it means automating mundane tasks -- most of which humans can accomplish already. If someone tells me they're an AI pessimist because they think automating tasks like "converse int
37.
by ambrozk 3y ago
Yes, but how do they know where we are in that growth phase? If you confidently tell me that "GPT-4 is the plateau," I want to know how you know that, specifically. "Well, because all deep learning technologies eventually slo
38.
by ambrozk 3y ago
Humans will never be intelligent. They're optimized for producing offspring, not reasoning. Humans may appear to be intelligent from a distance, but talk to one for any length of time and you'll find they make basic errors of reas
39.
by ambrozk 3y ago
This is exactly the point. The pessimists get the pedantic thrill of pointing out that, 60 years ago, some proponents were overconfident. But they neglect to notice the larger picture, which is one of extraordinary progress. They'll
40.
by ambrozk 3y ago
1. AI has not been "around the corner since the 1950s," and 2. if you think there hasn't been forward progress in AI since the 1950s, you have no valid opinions on this subject.
41.
by ambrozk 3y ago
This entire piece is based on one massive, unsupported assertion, which is that LLM progress will cease. Or, as the author puts it, "we are at the tail end of the first wave of large language model-based AI... [it] ends somewhere in th
42.
by ambrozk 3y ago
Why would that make it worthless?
43.
by ambrozk 3y ago
This sounds a lot like a disagreement over product decisions that the development team has made, and not at all what people normally think when you say "a new paper has proved GPT-4 is getting worse over time."
44.
by ambrozk 3y ago
The paper does things like ask GPT-4 to write code and then check if that code compiles. Since March, they've fine-tuned GPT-4 to add back-ticks around code, which improves human-readable formatting but stops the code compiling. This i
45.
by ambrozk 3y ago
By your definition, is a blind person capable of reasoning about visual data? Is a deaf person capable of reasoning about auditory data? Can a physicist understand the molecules, atoms, & subatomic particles which he or she can only int
46.
by ambrozk 3y ago
I used it extensively to debug a very thorny MySQL version upgrade. In my experience, it knows a lot about MySQL, and can reason about weird behavior very very effectively. A typical use is asking it something like, "Prior to my MySQ
47.
by ambrozk 3y ago
You need to define "true understanding" in some concrete, measurable way, or accept that you're just using it to avoid thinking clearly about AI capabilities.
48.
by ambrozk 3y ago
True! And that will come very soon.
49.
by ambrozk 3y ago
"No true understanding" is the new "no true Scotsman." If you're still repeating this line in mid-2023, you're not meaningfully engaging with the technological developments that are occurring in front of your e
50.
by ambrozk 3y ago
Yes, there is a hype cycle that afflicts every new piece of tech. The existence of hype isn't evidence either way. What makes smart people think that this time is different is a straightforward comparison of the capabilities of LLMs an
51.
by ambrozk 3y ago
People's freakouts are completely reasonable. The pace of development in this field is unreal and shows few signs of slowing down. The primary blocker to adoption in many fields is just software integration, which will come within a fe
52.
by ambrozk 3y ago
I see we've passed "first they ignore you" and moved onto the "next they laugh at you" phase of LLM denial. The next step is "you win."
53.
by ambrozk 3y ago
People repeating this take in the face of so much overwhelming evidence to the contrary look so ridiculous that at this point, you just have to laugh at them. Yeah, sure, it's not reasoning. That hour-long exchange I just had with it,
54.
by ambrozk 4y ago
> the atomization of intra-family bonds that seems so immoral to you is actually caused by the migration, driven by underlying economic opportunities and not some NIMBY anti-growth mindset The point is that we have to make a trade-off be
55.
by ambrozk 4y ago
Yep. And the core team has that "happy cult" vibe where they think that if they're (passive-aggressively) polite enough, they don't have to worry about anyone's opinion outside their insular little group. I tried to
56.
by ambrozk 4y ago
The policy they've chosen to advocate directly harms me. Not in a, "oh, no, there's now a construction project nearby" sort of way. In a, "I literally cannot afford to live in this city anymore, so I have to leave
57.
by ambrozk 4y ago
"A huge comeback" is a big overstatement. Overall, it's still a burnt-out husk of its former glory. But it is true that the city proper has developed something which it lacked circa 2000, which is non-auto jobs (Quicken Loa
58.
by ambrozk 4y ago
I think everything I wrote is accurate. Bandera was a vicious anti-Semite. Bandera did collaborate with the Nazis. Bandera is venerated in Ukraine (since 2014 and especially since 2022). Maidan was made possible by armed support fro
59.
by ambrozk 4y ago
They do. They also understand that there collaborators were Ukrainian nationalists (who were extremely anti-semitic and enthusiastically participated in pogroms) who are increasingly venerated in Ukraine. As an American, I'm able to co
60.
by ambrozk 4y ago
What you wrote is "Per capita, the people committing the most murders are white." My original statement was very obviously made with reference to a US legal context, and in that context, your statement is completely false. If you

More ›