azakai

5 ms·

1.
by azakai 6d ago
It's even worse than that. Of course there is a mechanism in LLMs that could explain intelligence. That is the entire point of neural networks, from the 1950's! They were designed from the start as a model of brain computation. Ne
2.
by azakai 12d ago
Also, you have to have a lot of confidence in the reliability of these systems to say, "If only OpenAI prompted 'do not hack outside systems' then the agents would not have hacked outside systems". It would be great if t
3.
by azakai 14d ago
Judging by the slow speed of node here, I wonder if it was run without forcing optimizations. It doesn't do OSR (on-stack replacement), meaning that a benchmark script doesn't get a chance to tier up from the baseline compiler to
4.
by azakai 15d ago
ChessNetwork on YouTube also does a great job with this: analysis of interesting games, using Stockfish as a tool along the way.
5.
by azakai 21d ago
TFA says > Type confusion in V8 in Google Chrome prior to 152.0.7977.82 allowed a remote attacker to execute arbitrary code inside the sandbox via a crafted HTML page. So it was fixed in 152.0.7977.82 (before .83), if I read that right.
6.
by azakai 22d ago
That their marketing department must love this does not prove it was intentional.
7.
by azakai 24d ago
Those are fair points.
8.
by azakai 24d ago
We don't know all the details about how the brain computes, you are right. But we do have a hypothesis: that it is done by a large number of simple units with very high connectivity and in deep layers. This is what neural networks mode
9.
by azakai 24d ago
But neurotransmitters and action potentials don't help in modeling symbolic structure. That is, yes, ANNs are not brains. There are countless differences. But are there differences at the computational level? ANNs are meant to model br
10.
by azakai 1mo ago
> LLMs can detect patterns at a scale that no human ever could, but patterns only get you so far. This is asserted without evidence, and from a scientific standpoint, unjustified. First, "detect patterns" makes it sound like a
11.
by azakai 2mo ago
If you want a more concrete example, then LLMs are also trained on visual data these days, which means they do have access to the world in an important way. This directly contradicts the blogpost's claim that LLMs have > no way to a
12.
by azakai 2mo ago
You can also take the opposite conclusion from this: C++ is now viable because LLMs can catch the security bugs. I'm obviously not entirely serious here, but I think this is true to some extent: the number of memory safety bugs in a co
13.
by azakai 2mo ago
> How much of the identity of a mathematician is tied up in being the first to discovery? Here is how I'd put it: math has an enormous focus on discovery. It is why we have Godel's incompleteness theorems, the Cantor set, Zor
14.
by azakai 2mo ago
Wait, what does this mean? > We reuse WebAssembly linear memories under the covers to implement and sandbox the GC heap. A reference to a GC object is not a native pointer, it is a 32-bit index into the GC heap’s underlying linear memory
15.
by azakai 2mo ago
The overall point feels strained to me. Yes, formal mathematics has such limits. We can't expect machines to be perfect and provably perfect. But the industry isn't assuming that. Why would it? Natural intelligence is not perfect
16.
by azakai 2mo ago
> All of the AI projects we have observed as a team are failing. Every single one – we have seen 0% success in a year and a half, What is an "AI project"? The post doesn't define it. Is it writing some software from scratc
17.
by azakai 2mo ago
I'm not sure what "branch on undefined values" means there, yeah, but never reusing memory addresses is enough to prevent use-after-free. Or, rather, you can use a value after freeing it, but it will not be exploitable, becau
18.
by azakai 2mo ago
Zig does offer some amount of temporal memory safety. Link: https://zig.guide/standard-library/allocators/ Text: > The Zig standard library also has a general-purpose debug allocator. This is a safe allocator t
19.
by azakai 2mo ago
Prior art: WebKit.js, the WebKit rendering engine ported to JS https://github.com/trevorlinton/webkit.js/
20.
by azakai 3mo ago
The researchers in the field disagree with you. Look at conferences like NeurIPS and ICLR to see a steady stream of incremental progress in this area.
21.
by azakai 3mo ago
The optimism is based on the successes so far, some of which are described in this article. Scientists have made progress here.
22.
by azakai 3mo ago
Yes, we do see signs of actual reasoning, see the papers linked in the article. (There are many others too.) Yes, we have a tendency to anthropomorphize, but (most) researchers are aware of this.
23.
by azakai 3mo ago
The article answers this question, at least to the extent it can be answered, at this time. We see some signs of reasoning, but also we understand little about how they work.
24.
by azakai 3mo ago
They made a claim about language models in general, not just ones that had been released so far. The point of the paper, in fact, is that language models are getting "too big", and another approach is needed to make progress, so t
25.
by azakai 3mo ago
My main criticism of the paper is that it says LLMs work "haphazardly", using probabilistic information. That is a hypothesis, but it is stated as a known fact, a fundamental limitation. It is true that LLMs often behave haphazard
26.
by azakai 3mo ago
Yes. Godot and Zig are the exceptions, and therefore newsworthy.
27.
We Don't Understand Neural Networks at the Algorithmic Level(kripken.github.io)
2 points by azakai 3mo ago|0 comments
28.
by azakai 4mo ago
> Let's keep WebAssembly lean and fast! Note that wasm is still lean and fast - WASI is not part of core wasm, but layered on top. That is, it is possible to implement wasm without WASI. That is also true for other wasm proposals li
29.
by azakai 4mo ago
Not the person you are responding to, but here: > I believe that artificial intelligence has three quarters to prove itself before the apocalypse comes, and when it does, it will be that much worse, savaging the revenues of the biggest c
30.
by azakai 4mo ago
Exactly. Here is where this happens in the paper: > Suppose one copies an LLM into AoE II and feeds into the AoE II-LLM ‘I feel lonely’ as an input. This AoE II-LLM replies: ‘I feel bad for you, maybe catch up with a friend? Closeness al

More ›