albertzeyer

8 ms·

61.
by albertzeyer 1y ago
There is also optical neuromorphic computing, as an alternative to electronic neuromorphic computing like memristors. It's an fascinating field, where you use optical signals to perform analog computing. For example: https:/&#x2F
62.
by albertzeyer 1y ago
I think he argues that they would not be able to play Atari games this way (I don't know; maybe I also misunderstood). But also, he argues a lot about sample efficiency. He wants to develop algorithms/methods/models which can
63.
by albertzeyer 1y ago
His goal was not just to solve Atari games. That was already done. His goal is to develop generic methods. So you could work with more complex games or the physical world for that, as that is what you want in the end. However, his insight i
64.
by albertzeyer 1y ago
> Google's first LLM to use diffusion in place of transformers. But this is a wrong statement? Google never made this statement? You can have a Transformer diffusion models. Actually Transformers are very standard for all of the dis
65.
by albertzeyer 1y ago
4GL and 5GL are already taken. So this is the 6GL. https://en.wikipedia.org/wiki/Programming_language_generatio... But speaking more seriously, how to get this deterministic?
66.
by albertzeyer 1y ago
It seems the main complaint is about confusing shapes / dimensions. Xarray has already be mentioned, but this is a broader concept, called named dimensions, sometimes also named tensors, named axes, labeled tensors, etc, which has ofte
67.
by albertzeyer 1y ago
Just by the mathematical definition of interpolation ( https://en.wikipedia.org/wiki/Interpolation ), any function which approximates the given regression points (training data), and is defined for values in between (uns
68.
by albertzeyer 1y ago
Are there any details on what they changed to improve over other existing models?
69.
by albertzeyer 1y ago
It links to this file: https://drive.google.com/file/d/1j1ofmm8iBaVreGC5TSF1oLsrOqB... But all but the first page seems to be missing in this PDF? There is just an abstract and (partial) outline.
70.
by albertzeyer 1y ago
That link is dead now? But I guess you mean this? https://www.sciencedirect.com/science/article/pii/S000437022... "Reward is enough", David Silver, Satinder Singh, Doina Precup, Richard S. Sutton, 2
71.
by albertzeyer 2y ago
Why do you say FlexAttention is too buggy? I have heard about a lot of successful usages of it, and never heard about any such problems. Also note, depending on your model dimensions and sequence lengths, often the attention computation pla
72.
by albertzeyer 2y ago
For the matter-antimatter ratio, you would not expect 50:50, or would you? Because 50:50 would be a highly unstable system? In any case, you would expect that unstable states would be highly unlikely, and it would converge into a stable sta
73.
by albertzeyer 2y ago
Jürgen Schmidhuber has a paper with Lucas Beyer? I'm not aware of it. Which do you mean?
74.
by albertzeyer 2y ago
Stack traces are very valuable. Sometimes it can even help to attach them to some object creation, when you later wonder why/how/where this object was created. E.g. in TensorFlow, every single Tensor had a traceback attached to it
75.
by albertzeyer 2y ago
To clarify: The situation is still not completely understood? It's not just only the computed gotos, but there is some other regression in Clang19? Basically, the difference between clang19.nocg and clang19 is not really clear? Btw, wh
76.
by albertzeyer 2y ago
> However, there should be no direct impact on users. I find this quite impressive, that they rewrote the whole Fish core, but everything keeps working exactly in the same way (except very few minor things which change in only minor ways
77.
by albertzeyer 2y ago
> This got me wondering why the filesystem itself doesn't run a similar kind of deduplication process in the background. I think that ZFS actually does this. https://www.truenas.com/docs/references/zfsdedup
78.
by albertzeyer 2y ago
I wrote a similar (but simpler) script which would replace a file by a hardlink if it has the same content. My main motivation was for the packages of Python virtual envs, where I often have similar packages installed, and even if versions
79.
by albertzeyer 2y ago
Yes I read it. I don't think these suggestions really help much, or are really new. E.g. simplify bureaucracy and regulations, that is what most parties already claim to do since many many years. I think many people really want that, b
80.
by albertzeyer 2y ago
There are a lot of such companies already in Germany. Basically most small/medium sized IT companies in Germany fit that classification. So I don't really see how this is now a new approach. And I'm also not sure what is prop
81.
by albertzeyer 2y ago
I also just read that paper. But I wonder, even though MLA is strictly more powerful, do you really gain by that in experiments? This paper doesn't really do too much experimental comparisons. GQA on the other side should still be fast
82.
by albertzeyer 2y ago
I have worked both with the TensorFlow C++ API and the TensorFlow Python API. While the TF Python API is basically only a wrapper around the TF C++ API, it adds a lot of things on top, e.g. many higher-level functions you would want to use
83.
by albertzeyer 2y ago
Yes that's certainly true. I was a bit hesitant to post a link from Gary Marcus. But I was mostly posting it for the Elon tweet. I assume the tweet is not fake. So you can ignore about Garys opinion here and just take Elons tweet as it
84.
by albertzeyer 2y ago
https://garymarcus.substack.com/p/elon-musks-terrifying-visi... I'm not sure if this was a very bad joke by Elon, or if Grok 3 is really biased like that.
85.
by albertzeyer 2y ago
I think this was my first (or among my first) Linux distributions, around 2000 or so. I did not had Internet access back then. I had some coding experience (mostly Basic; I was just learning C++). I made a dual installation with Windows. I
86.
by albertzeyer 2y ago
It's really a pity that they do this now. Some of their older papers had actually quite some valuable information, comments, discussions, thoughts, even commented out sections, figures, tables in it. It gave a much better view on how t
87.
by albertzeyer 2y ago
You might be true for the market. However, that target audience, those hobby enthusiasts, hobby developers, also university labs with low budget, those are the people who will develop the future open source frameworks, and ultimately/i
88.
by albertzeyer 2y ago
Can you give some example? I mostly also care about energy efficiency. How much energy would the alternatives consume?
89.
by albertzeyer 2y ago
The development writeup for the Doom is interesting, with many details. https://nicholas.carlini.com/writing/2019/javascript-doom-cl... There was one month time to complete the competition. But it seems you were a
90.
by albertzeyer 2y ago
Why do you think these activities are obsolete? Meeting the other people face-to-face will always be nice, or not? And also playing together in the same room is much nicer than when you are separated. I'm quite sure you will still be a

More ›