currymj

8 ms·

61.
by currymj 1y ago
software is really weird as a test case for understanding AI automation on white collar work. it seems exceptionally well-suited to AI-based automation because software engineering has already needed to figure out how to efficiently cope wi
62.
by currymj 1y ago
the post that I replied to?
63.
by currymj 1y ago
AlphaFold is real. To the extent you care about chess and Go as human activities, progress there is real. there are some other scientific computing problems where AI or neural-network-based methods do appear to be at least part of the actua
64.
by currymj 1y ago
The BERT model, which uses the transformer architecture, was deployed by Google for every English language Google search by the end of 2019. This is about concurrent with OpenAI's release of GPT-2. But GPT-2 was not really a product.
65.
by currymj 1y ago
a lot of the ChatGPT assignments are so incredibly obvious. in the most egregious cases literally copy and pasted from the browser without reading. laziness is all-pervasive. the problem is an academic cheating penalty can have grievous con
66.
by currymj 1y ago
> "hey, i am a COMPUTER and a small set of fixed moves should take me about 300ms or so to fully solve out" from the article: "3. Attempt to Use Python When pure reasoning was not enough, o3 tried programming its way out o
67.
by currymj 2y ago
since late 2024/early 2025 it now is the case, especially with a reasoning model like Sonnet 3.7, DeepSeek-r1, o3, Gemini 2.5, etc., and especially if you upload the textbook, slides, etc alongside the homework to be cheated on. most n
68.
by currymj 2y ago
Well, a big difference is that arithmetic is something you learn in elementary school, whereas LLMs can do a large fraction of undergraduate-level university assignments.
69.
by currymj 2y ago
if it leads to more home runs i'm against it. if it leads to more solid hits and plays in the infield, i'm for it. unclear which one, i look forward to finding out more.
70.
by currymj 2y ago
I agree this is true (for mainly political/interpersonal reasons) if you’re writing code inside a typical software engineering organization, which orients itself to producing software products. But lots of people write computer program
71.
by currymj 2y ago
some responsible yet still "serious" uses would include: 1) throwaway code where the "work product" is not a software system, but rather the outputs of the code which you can verify yourself. the classic example for me i
72.
by currymj 2y ago
the US model has focused less on exams and more on take-home assignments. this can be better because most people perform better without artificial pressure, and it's possible to ask deeper questions than on a timed exam. it's just
73.
by currymj 2y ago
i agree with you in spirit (I pronounce Paris as Paris). however I have never heard of someone pronouncing Freud as Frood, outside of "Bill & Ted's Excellent Adventure". https://www.youtube.com/watch?v=Sob
74.
by currymj 2y ago
it’s called a flipped classroom and students universally hate it.
75.
by currymj 2y ago
In Mice
76.
by currymj 2y ago
i can imagine a tool where you take a picture of a cluttered desk or closet, and it produces a list of all the objects and then comes up with a plausible organization plan. that's a little more complicated than these tools, but it seem
77.
by currymj 2y ago
Tone markers are of limited use to Chinese readers (instead, just show them the characters). They are also of limited use to non-Chinese readers, who don't understand the tone system and probably can't even audibly distinguish ton
78.
by currymj 2y ago
you sort of can do (a decent approximation of) this, it’s just even the approximate version is impractical for computational reasons. https://www.anthropic.com/news/influence-functions
79.
by currymj 2y ago
i also doubt practicality. but if the technology worked "well enough" and the major consumer-facing AI companies did it, it would help a lot with certain problems. if you're technically sophisticated you can easily evade it o
80.
by currymj 2y ago
you might enjoy this read, which is an up-to-date document from this year laying out what was the state of the art 20 years ago: https://web.stanford.edu/~jurafsky/slp3/3.pdf Essentially you just count every n-gra
81.
by currymj 2y ago
this is pretty close to how language models worked in the 90s-2000s. deep language models -- even GPT 2 -- are much much better. on the other hand, the n-gram language models are "surprisingly good" even for small n.
82.
by currymj 2y ago
it's particularly bad for students who should be trying to learn. at the same time in my own life, there are tasks that I don't want to do, and certainly don't want to learn anything about, yet have to do. For example, figuri
83.
by currymj 2y ago
it's not clear where Severance takes place exactly. But it is wintery and has universities and decrepit fishing towns. So if it's supposed to be New England, i think this makes sense. There are a lot of very successful people in N
84.
by currymj 2y ago
generally you are right in spirit. however multi-armed bandit algorithms are highly useful in practice. these are a special case of RL (RL with one state, essentially). there are even some extensions of applied bandit algorithms to "tr
85.
by currymj 2y ago
Find materials on PPO which should be widespread since it is the most popular RL algorithm. GRPO works on the same principles, just makes certain estimates from samples rather than training an auxiliary neural network to make them.
86.
by currymj 2y ago
that was “bitter lesson” in action. for example there are clever ways of rewarding all the steps of a reasoning process to train a network to “think”. but deepseek found these don’t work as well as much simpler yes/no feedback on examp
87.
by currymj 2y ago
their marketing photos include 1) a game controller next to the PC, 2) a bottle of Bawls soda next to the PC, so I think so.
88.
by currymj 2y ago
this feature is one where ChatGPT will actually do a Bing search (sometimes rewriting your search query), and then show you a summary of the content of the links. so "hallucinations" are more rare, although the model may be very g
89.
by currymj 2y ago
i actually don’t think nontechnical people understand the result they want of code. have you ever seen those experiments where they asked people to draw a picture of a bicycle, from memory? people’s pictures made no mechanical sense. often
90.
by currymj 2y ago
I think if you believe LLMs can truly generalize and will be able to replace all labor in entire industries and 10x every year, you pretty much should believe in ASI at which point having a job is the least of your problems. if you rule out

More ›