namaria

22 ms·

181.
by namaria 2y ago
I'm personally holding out for Ludicrousthink
182.
by namaria 2y ago
Talking to some younger colleagues over drinks the other evening they showed me their Instagram feed. It's all AI slop. Machine generated jokes. For all the talk about jobs and art, LLMs seem to love shitposting.
183.
by namaria 2y ago
I agree, it is absolutely not a skill. LLMs are a black box and the models keep changing under you, and their output can change if you try the exact same input more than once. People claiming it's a skill should read up on experiments
184.
by namaria 2y ago
Beware of Gell-Mann amnesia, validation bias and plain nonsense written into summaries LLMs do. I have fed ChatGPT a pdf file with activity codes from a local tax authority and asked how I could classify some things I was interested in doin
185.
by namaria 2y ago
Oy vey not this paper again. "Our methods study the model indirectly using a more interpretable “replacement model,” which incompletely and imperfectly captures the original." "(...) we build a replacement model that approxim
186.
by namaria 2y ago
Bingo. LLMs are consuming data. They cannot generate new information, they can only give back what already exists or mangle it. It is inevitable that they will degrade the total sum of information.
187.
by namaria 2y ago
Atheism is such a weird position to take. Why define a negation of something you don't believe to be real? I'm not "a-lochnes-monster-ist" or "ayettist". If someone thinks the idea of a deity is nonsensical why
188.
by namaria 2y ago
The training process doesn't preserve information needed for the LLM to infer that. It cannot be anything other than nonsense that sounds plausible, which is what they do best.
189.
by namaria 2y ago
I enjoy this blog, the articles are usually very well informed. But this kind of grand theory in History is inherently flawed. There is a lot of irreducible complexity in History and trying to draw conclusions from sweeping low resolution p
190.
by namaria 2y ago
Ashby in 1958 pointed out the law of requisite variety. It should have preempted expert systems and it should preempt the current agents fad. An automatic control system of general application would tend toward infinite complexity.
191.
by namaria 2y ago
I've come to resent the frenetic pace demanded of everything now. Why does everything must keep accelerating? Slow down and fix things I say.
192.
by namaria 2y ago
A feedback with delayed signalling is a recipe for system instability and runway behaviors. We will have a better idea of whether LLMs are fine for code generation a bit further down the line.
193.
by namaria 2y ago
The interpretation this paper offers is very questionable. It observes a so-called "replacement model" as a stand-in because it has a different architecture than the common LLMs, and lends itself to observing some "activation
194.
by namaria 2y ago
While bleeding cash faster than anything else in History.
195.
by namaria 2y ago
I like the Huxley inspired 'intelligence surrogate'.
196.
by namaria 2y ago
No, mental models matter. This has nothing to do with AGI doomerism. Knowing implies reasoning. LLMs don't "know" things. These statistical models continuate text. Having a mental model that they "know" things, that
197.
by namaria 2y ago
They have more data in English than Spanish. LLMs don't know or reason or follow instructions. They merely render text continuations that are coherent with the expectations you set when prompting. The fact that they are not able to sus
198.
by namaria 2y ago
Thank you! I had an emotional reaction to the founder worship.
199.
by namaria 2y ago
Deep Search is pretty good for current news stories. I've had it analyze some legal developments in a European nation recently and it gave me a great overview.
200.
by namaria 2y ago
Yes. There are different concepts called 'entropy', sometimes merely because their mathematical formulation looks very similar. It means different things in different contexts and an abstract discussion of the term is essentially
201.
by namaria 2y ago
I like Deep Research but as a historian I have to tell you. I've used it for history themes to calibrated my expectations and it is a nice tool but... It can easily brush over nuanced discussions and just return folk wisdom from blogs.
202.
by namaria 2y ago
> The framers held certain rights to be unalienable from human beings - something that no government can take away Unless, of course, the government considers you to be 2/3 of a person
203.
by namaria 2y ago
> it has also been de facto illegal to have demographic compositions substantially different from the general population How so? To which law or case precedent?
204.
by namaria 2y ago
> Also, I have no doubt that there are problems that can't be solved with just an LLM but would need abductive extensions. And we're back to expert systems.
205.
by namaria 2y ago
Theory of constraints is clear: speeding up something that isn't a bottleneck worsens system performance. The idea that too little code is the problem is the problem. Code is liability. Making more of it faster (and probabilistic) is a
206.
by namaria 2y ago
When using low traction languages and claiming LLMs are a boon, I often wonder if one doesn't end up with an even lower traction language by trying to figure out how to phrase things in English. In my experience, the solution to low tr
207.
by namaria 2y ago
> As mentioned by another comms ter, the solution could be to find a way to separate the command and data channels. The LLM only operates on a single channel, that being input of tokens. I think the issue is deeper than that. None of the
208.
by namaria 2y ago
It's just a meet up man. You go there, meet some people, have some conversations. Sharing information is the quintessential non zero sum game humans play.
209.
by namaria 2y ago
> intelligent beings can communicate in the context of a lot of prior knowledge This is key. It works because of previous work. People have shared context because they develop it over time, when we are raised - shared context is passed o
210.
by namaria 2y ago
Another issue I see is the "Machine Stops" problem. When we come to depend on a systems that fails to foster the skills and knowledge needed to reproduce it (i.e. if programming comes to be so easy to so many people that they don&

More ›