dontwearitout

10 ms·

1.
by dontwearitout 7mo ago
Chapter 1 of "The Ministry of the Future" describes a fictional wet bulb event. It's grisly and horrific and I highly recommend you read this chapter, it changed my view on climate change. https://books.rockslide.c
2.
by dontwearitout 11mo ago
This is the "hard problem of consciousness". It's more important than ever as machines begin to act more like humans, but my takeaway is we have no idea. https://en.wikipedia.org/wiki/Hard_problem_of_cons
3.
by dontwearitout 2y ago
How many tokens/s do you get on a 3090? With the extra tokens for the internal monologue, is it still performant enough for smooth VSCode integration?
4.
by dontwearitout 2y ago
Dissociatives would work, like dextromethorphan or ketamine. Psychedelics are a subset of hallucinogens.
5.
by dontwearitout 2y ago
I've never found it compelling that blinding isn't possible for drug-naive patients. There are other drugs that could induce a "trip" and an unfamiliar individual could mistake for a minor psychedelic experience.
6.
by dontwearitout 2y ago
The energy of neutrons isn't really analogous to the energy of atoms in chemical reactions, but absolutely affects the reaction dynamics. The "cross section", or interaction probability, is a strong function of neutron speed.
7.
by dontwearitout 2y ago
They certainly can, see https://en.wikipedia.org/wiki/Resonance_escape_probability . The all-important number in nuclear reactions is "k", the average number of child neutrons a single neutron will produce. Th
8.
by dontwearitout 2y ago
Claude notably does not use RLHF, but uses RLAIF, using a LLM to generate the preferences based a "constitution" instead of human preferences. It's remarkable that it can bootstrap itself up to such high quality. See https
9.
by dontwearitout 2y ago
Are dendritic sub-compartments necessary to explicitly model, or does this work just imply that biological neurons are complicated and are better modeled as a multi-layered artificial network, rather than a single simple computational unit?
10.
by dontwearitout 2y ago
Your "blip" anecdote is super interesting. I know that exact sensation of disorientation (but without the migraines thankfully), and I'm curious if this has been studied in depth anywhere.
11.
by dontwearitout 2y ago
I don't know if you're out of the loop but the AI scene has dramatically changed in the past few years. We are solidly out of the AI winter.
12.
by dontwearitout 2y ago
I haven't heard the term "shallow basin hypothesis" but I know what it refers to, these two papers spring to mind for me: 1) Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs https://arxiv.org/abs&
13.
by dontwearitout 3y ago
I don't think a dot product between high dimensional vectors is considered a convolution? I'm familiar with convolution between continuous functions, and with kernels in neural networks providing invariance. I'd love to learn
14.
by dontwearitout 3y ago
Lots of interesting work out there; time will tell!
15.
by dontwearitout 3y ago
The transformer module is currently dominating ML, and is widely used in text, vision, audio, and video models. It was introduced in 2017 and shows no real signs of being displaced. It has no convolutions. https://en.wikipedia.or
16.
by dontwearitout 3y ago
Does this include tools to evaluate for performance on out-of-distribution and adversarial images?
17.
by dontwearitout 3y ago
Their point was the insane efficiency, not the low consumption. Modern LLMs are many orders of magnitude less energy efficient; despite all our progress computational biology makes our silicon looks primitive in some metrics.
18.
by dontwearitout 3y ago
Yep, transformers showed up in 2017, nearly 7 years ago, and they still wear the crown. Maybe some new architecture will come to dominate eventually, but I would love a low cost PCIe board that could run 80B transformer models today.
19.
by dontwearitout 3y ago
Diffusion models could actually be implemented with transformers, hypothetically. Their training and inference is what makes diffusion models unique, not the model architecture.
20.
by dontwearitout 3y ago
There's an ocean of difference between optimizing for a single wakeword and the class of models that are taking off today. I'm excited for more on-board processing, because it will mean less dependency on the cloud.
21.
by dontwearitout 3y ago
This only goes back to 1913, but says $1 in 1913 is worth $30.65 today. That's pretty rough. https://www.minneapolisfed.org/about-us/monetary-policy/infl...
22.
by dontwearitout 3y ago
Does anyone know of any photo management projects that include integration with recent ML models for classification and captioning? It'd be awesome to have a system that could automatically generate (model versioned) CLIP or SAM embedd
23.
by dontwearitout 3y ago
I think the point being made is that without grid scale storage, wind and solar are not full solutions and not comparable to nuclear energy. Grid scale storage capacity will come, but it's not here yet.
24.
by dontwearitout 3y ago
I had to look this up - apparently it's around 0C if you do this! https://mynasadata.larc.nasa.gov/sites/default/files/2018-12...
25.
by dontwearitout 3y ago
An aside, but do you find the quality improvements in GPT-4 are necessary for your daily use, or is 3.5 80% as good?
26.
by dontwearitout 3y ago
> Definitely a good time to go long on uranium prices in any case. Is there an easy way for a casual investor to do this?
27.
by dontwearitout 3y ago
But it's naive to think there's no effect - some level of chemophobia is warranted IMO, because we do not understand all the complex second order effects to these powerful compounds. Case in point: the article we're discussin
28.
by dontwearitout 3y ago
There is Zoox
29.
by dontwearitout 3y ago
It's great for AI. Today's large language models are very hungry for RAM. Consumer electronics have been rocking just a few GB of RAM for the last decade because there was no real usecase for 100+GB, but that has changed since GPT
30.
by dontwearitout 3y ago
Is it an either-or thing? The Nature link I responded to above proposes that human ancestors were coastal dwellers for a few 10's of thousands of years to survive a climate catastrophe. How long would it take for this to start shaping

More ›