317070

5 ms·

31.
by 317070 2mo ago
Different people have different susceptibilities to getting addicted. And once addicted different people have different amount of brainspace left in their life to quit addictions, also depending on how hard the rest of society makes it to
32.
by 317070 3mo ago
For many people, it is the other way around. It is very remarkable that there is a bird, which looks so much like a big version of this butterfly! After all, in Europe these butterflies are commonplace, but I've never seen the American
33.
by 317070 3mo ago
Those other parties all declined to compete in this by-election. They want Farage to stand to the rule of law on his corruption, and not endorse this procedural manoeuvre. The timing of this by-election is also such that, were there an actu
34.
by 317070 3mo ago
"Ethnic Chinese" is a term covering 1.45 billion people. I don't even know where one would find a definition for "ethnic English", but if you take the NHS' "ethnic British" which ridiculously excludes
35.
by 317070 3mo ago
A datapoint that points to the contrary: - Singapore pre-1965 was a low trust, racist society. The tensions were so bad that in 1964 there were racial riots. - Today, after a lot of immigration, within 1-2 generations, Singapore became a hi
36.
by 317070 3mo ago
I reckon Paul only claims to have created the webpage titled 'Triple Dragon Fractal'.
37.
by 317070 3mo ago
I fact checked: Chomsky has never been on Epstein's island.
38.
by 317070 3mo ago
In the OECD data averaged here, I reckon this chemo therapy is counted as sick leave. On a first search, the metric seemed to be defined as "(compensated) absenteeism from work due to illness, days per employee per year"
39.
by 317070 3mo ago
I probably get there, but I have young kids. But yes, these are averages between 1 person having 12 weeks and 12 people with 1 week. It's most likely power law distributed, so the average will feel weird. There are people with cancer,
40.
by 317070 3mo ago
My portable CO2 monitor goes off. You can set a levels of warning on the aranet. It is a very quiet, non-disruptive alarm, but an alarm nonetheless. I agree with OP. I don't always carry it along, but it has been a massive boost to my
41.
by 317070 3mo ago
The UK did not ban AC. Don't read the Telegraph, and if you do, don't trust it. Source: I live there
42.
by 317070 3mo ago
Well if it was the data that was copied, nobody would be using LLMs. The data-generating process is the thing that would be copied. That's why we do appreciate the nth artist making classical or techno music.
43.
by 317070 3mo ago
Right, and what happens at that limit is most exciting! A model that has a cross entropy at that limit for a data stream of text, produces a stream of text that is both theoretically and practically indistinguishable from the original strea
44.
by 317070 3mo ago
> for LLMs, because in practice floating point inaccuracies (in particular after exponentiation) prevent values from being exactly equal. In one thinking trace of 10k tokens, with fp16 or bf16 logits, I don't reckon a collision is r
45.
by 317070 3mo ago
If RL was used to train the model, the model will have been trained on its own sequences. Those will have been generated with a temperature of 1.0. They must be, otherwise you would get a premature collapse or explosion of your entropy if t
46.
by 317070 3mo ago
Actually, Google's TPUs are also deterministic!
47.
by 317070 3mo ago
> Look at the softmax function and take the limit as T->0. It becomes a dirac-delta function. In pure math, it does not always do that. It becomes a dirac-delta comb with equal weight on every maximum. There can be more than 1 maximum
48.
by 317070 3mo ago
> so in principle, setting temperature to 0 _should_ result in deterministic outputs It is a common misconception, but it is not true even in principle. If I have 2 or more logits which are equal to the maximum of my logits, I will sampl
49.
by 317070 4mo ago
A flower, a picture of the flower in print and the picture shown on a screen will all have different spectra, but look the same. See the first minutes of this video, where he has a spectrum analyser: https://youtu.be/-DyrBDs
50.
by 317070 4mo ago
Yes, people are using the programming language Lean for that, and there are a few less popular alternatives as well. Fundamentally, there is a one-to-one correspondence between mathematical proofs and programming. Proofs are isomorphic to t
51.
Reinventing Entropy – Compression and Intelligence Part 1 [video](youtube.com)
3 points by 317070 4mo ago|0 comments
52.
by 317070 4mo ago
Ha, thanks for sharing this! I've been building Gemini live since before ChatGPT came out. I am so thrilled to see it actually helping people in the wild!
53.
by 317070 4mo ago
I mean, he looks uncomfortable, but you would be surprised at how much people can tolerate when there is no alternative. Here is an interview I found [0]. I think he looks better than every 90 year old. But he also mentions that it still is
54.
by 317070 5mo ago
It's been used, along with every other divergence and distance you can think of. In practice, which divergence you use doesn't seem to be very important. The KL is the one with the most theoretic foundation though, i.e. will work
55.
by 317070 5mo ago
It's not just kidnapping though. You also need road safety, or some level of pedestrian safety. By far the most dangerous thing for kids, is traffic. And in many places that is the delimiter of their freedom.
56.
by 317070 5mo ago
> To get there, you often need to slow down your brain's electrical activity, moving from active Beta waves into Alpha or Theta waves through meditation or deep focus. This blurs the boundary between the inner "self" and t
57.
by 317070 5mo ago
If you want to read more: the concept is called "the dual state" [1] after the eponymous book [0] I agree that the phrase is somewhat contradictory, but it is the best way to describe what was going on. As long as you were within
58.
by 317070 5mo ago
Not sure if it matters, but that is at least not true for nazi-style fascism. In there, they had a very strong rule of law for most people. But, there was a dual, a parallel system where there was no law at all, it operated outside of the l
59.
by 317070 5mo ago
Named tickets, like airplane seats? Sorry, I only thought about this for 5 seconds, but there are markets where scalping doesn't cause issues. We could look at those.
60.
by 317070 5mo ago
A theory that skips the parameter space, and understands grokking theory, comes up with an unexplained update rule, which notably works on a per-parameter level by dropping the updates for most parameters. I suspect there is going to be a l

More ›