addag

3 ms·

1.
by addag 6d ago
Seems like content curation is becoming an increasingly important problems in online communities. Eventually a new equilibrium will be found, I'm wondering what it will look like.
2.
by addag 10d ago
Agreed, what I understand from RSI would be models creating new models, or at least upgrading their own weights/architecture. It does not seem to be the case here.
3.
by addag 10d ago
This technique is very useful to gain intuition for a given sample size. Just run a few simulations with uncorrelated data and then you can get a sense of how extreme the estimators can be.
4.
by addag 10d ago
Oh gosh, if only it was just the whatsapp chats...
5.
by addag 10d ago
This point could be made without denying the possibility of AI consciousness.
6.
by addag 10d ago
I am not saying that everything that a LLM say is true (the human without pain receptors can also say "I have pain" without feeling any pain). Just that we cannot exclude that LLMs can have phenomenological consciousness by a simp
7.
by addag 10d ago
About your last point, I thought so too a few years ago, but interestingly the science of consciousness is an emerging field, although empirical testing is still hard to do (see for instance https://www.youtube.com/watch?v=j
8.
by addag 10d ago
I'd argue back that using the substrate as a reason why there should not be consciousness seems quite weak. A competing thesis is that what matters is the emergent properties, whatever the support is. So far it has been true for some
9.
by addag 10d ago
I'd argue it is mostly a technical constraint in some LLMs which is due to a few optimization factor (injected temperature, random rounding error caused by parallelism). In practice you could very well create a LLM that always reply t
10.
by addag 10d ago
It is interesting to see that in a time when a lot of people accept the theory of materialism for the human brain (i.e the view that everything is physical and the mind is a product of brain), the same people tend to have a "hidden&qu
11.
by addag 10d ago
Is it? Do you believe that there is something more than pure physical phenomenon that make you brain work? If not, then what if we find a way to get your brain back to the state it was 5 minutes ago? It is just a matter of arranging the sta
12.
by addag 10d ago
I don't think this is the right argument to make here. Until we have a definite empirical way to measure consciousness, there is now way to say with certainty whether LLMs are or not conscious. That being said, if frontier labs actuall
13.
by addag 15d ago
Well not only research, but also a lot of other aspects of life; it is way easier to interact with something that has always an answer is polite whatever tell them.
14.
by addag 15d ago
Technically text generation was there way before self driving (e.g markov chain generators are there from the 1990s). The hard thing was to make it sound smart though.
15.
by addag 22d ago
I'm new to the mechanistic interpretability field, but from what I have read insofar, a lot of papers have relied on ablation/causal interventions to prove the faithfulness of their models. Do you have a simple explanation of why
16.
by addag 22d ago
Is it assumed that the total consumption remains the same (i.e there is an increase in consumption in clean energy when there is a decrease in less clean ones)? Otherwise, there would be an obvious solution which is to increase the price al
17.
by addag 22d ago
That's why you need those 5 dice to decide it.
18.
by addag 22d ago
Crazy hack considering the order of magnitude...
19.
by addag 22d ago
I thought the same when I saw that the financial industry was hiring FPGA people for low-latency algorithms. My understanding (as a non-FPGA expert) is that currently FPGA beats generic hardware (CPU,GPU) for "small size algorithm&quot
20.
by addag 23d ago
Sure they "don't go rogue" as if they are doing actions maliciously. Instead there is an emergent behavior from a swarm, that is unpredictable and can lead to unintended adverse outcome. From an AI safety practical standpoint
21.
by addag 23d ago
I'd say it is because of the time factor. It is one thing to have a lot of money, it is another thing to have robust systems that have been developed and tested for years. Money can "buy development time" only up to a certain
22.
by addag 23d ago
I hope you are sarcastic, right?
23.
by addag 23d ago
It seems like it is the bitter lesson of the emergence of intelligence.
24.
by addag 23d ago
The whole history still goes through their servers, though.
25.
by addag 23d ago
And even if they are not doing it right now, they probably keep the history available for future training, "just in case".
26.
by addag 23d ago
The weird similarity between the engineers make it strangely look like it is AI generated (although it is not).
27.
by addag 23d ago
My physics teacher takes the spherical roast beef as an example for heat convection.
28.
by addag 24d ago
I'm wondering if it can be used as a low-discrepancy sequence
29.
by addag 24d ago
From the abstract "Further, our symbolic approximation allows us to modify an LLM's behavior in targeted ways via precise interventions on its internal representations [...]". If this is true and easily computable, this might
30.
by addag 24d ago
While I agree with this statement, one could argue that what's important is not much the support but the emergent properties - in the same way that a wave is still a wave whether it is in the water or in the air. Thus putting things si

More ›