inciampati

9 ms·

91.
by inciampati 2y ago
Yes it is, because the post discussed this approach precisely because unrolling the actual chain of thought in interactive chat does not work. And it's doubly relevant because chain of thought let's transformers break out of TCO c
92.
by inciampati 2y ago
Where is that documented? Fwiw, interactive use suggests they are not available to later invocations of the model. Any evidence this isn't the case?
93.
by inciampati 2y ago
o1 appears to not be able to see it's own reasoning traces. Or it's own context is potentially being summarized to deal with the cost of giving access to all those chain of thought traces and the chat history. This breaks the comp
94.
by inciampati 2y ago
Looking at o1's behavior, it seems there's a key architectural limitation: while it can see chat history, it doesn't seem able to access its own reasoning steps after outputting them. This is particularly significant because
95.
by inciampati 2y ago
A regular EV also requires no special infrastructure. Just your regular house electrical system (e.g. 120v wall outlet in the US). Only on long trips do you need fast chargers or does range anxiety kick in. If you do a lot of long drives I
96.
by inciampati 2y ago
Poetry with a heavy dose of truth.
97.
by inciampati 2y ago
the recurrent model needs a mechanism to replay past context. no need to go quadratic to access all of it. they could replay multiple times to get effects similar to attention. the hardware lottery, well... imo it's really about levera
98.
by inciampati 2y ago
> They shouldn't be able to do this Really? ;) I guess you don't believe in the universal approximation theorem? UAT makes a strong case that by reading all of our text (aka computational traces) the models have learned a human
99.
by inciampati 2y ago
Want reliable AI? Stop approximating memory with attention and build reliable memory into the model directly.
100.
by inciampati 2y ago
Socializing is always draining. It's a physical fact that it simply takes a huge amount of energy to engage with other people, no matter what you think your personality type is. Dealing with socialization is a big part of why we have t
101.
by inciampati 2y ago
FWIW, I'm "extroverted" in the terms used in this thread, but I'm also all of these: mathemetician, farmer, scientist. We can work on monk or priest but those might be mutually exclusive!
102.
by inciampati 2y ago
Yes, extroverts do understand this limited capacity. It's like when you live an ultra sedentary lifestyle, and one day you realize you can't catch your breath after walking up four flights of stairs. Like any capacity, socializing
103.
by inciampati 2y ago
Telomere length is dynamically regulated. It sounds like SCNT does well at triggering the correct reprogramming to reset epigenetic features that might have led to Dolly's troubles (although it seems these were greatly overstated: htt
104.
by inciampati 2y ago
Imo the microecon metaphor is off base. This is about any parallel process being limited by it's serial phases. There are ways of looking at economies that see this process angle where Amdhal's law plays a role. But it's not
105.
by inciampati 2y ago
In order to survive, you wouldn't want to be wiped out if your home stream vanished. You'd want at least the likely chance of going to another stream to spawn and breed. Probably the salmon just swim upriver when they want to spaw
106.
by inciampati 2y ago
Exactly. Use aider to do this. Tell claude or your favorite LLM to write a full plan to implement what you need in such a way that your coworker can implement it. Copy the result into aider, and check the results!
107.
by inciampati 2y ago
Extremely high value analysis! Probably why we aren't seeing an announcement for a motive product release.
108.
by inciampati 2y ago
The repair of the wear and tear seems to provide more opportunities for the body to reject cancers. Also, aerobic activity may encourage selection for oxidative metabolism which is very suppressed in most cancers. It's counterintuitive
109.
by inciampati 2y ago
You can use it for everything. Just make sure that you have an input method set up on your computer and phone that allow you to use whisper. That's how I'm writing this message to you. Learning to use these speech-to-text systems
110.
by inciampati 2y ago
Yes, it's not for papers.
111.
by inciampati 2y ago
Then you have to boot it up. Bio equivalent of putting the lightning in the rock (semiconductors). The DNA is like the lightning (like the code) the rock is the biological system you drop it into to run it. Booting viruses is not super easy
112.
by inciampati 2y ago
Yes, they absolutely are! If this thing they are working on (or prognosticating about) is world endingly dangerous, it increases their importance.
113.
by inciampati 2y ago
OpenAI created a hidden token based money printer and don't want anyone to be able to audit it.
114.
by inciampati 2y ago
find ... | xargs head -n -0
115.
by inciampati 2y ago
Are you familiar with ColabFold? https://github.com/sokrypton/ColabFold
116.
by inciampati 2y ago
But it never quite clicked with everyone. It's nasty to do it on the sly.
117.
by inciampati 2y ago
Is water resistance a reason why we're seeing the elimination of the 3.5mm jack?
118.
by inciampati 2y ago
If you are working outdoors in hot weather (35°+) you can easily require 8-10L of water a day. That's like 50 "glasses". Then the next day if it's 20° you'll need only a handful of liters. It all depends on context.
119.
by inciampati 2y ago
This program is incredibly difficult to get access to and has been monopolized by a few elite institutions whose name recognition potential seems to have blinded funders. These institutions basically control everything about the cohort, but
120.
by inciampati 2y ago
Does quanta magazine manage to reach this level of detail in other fields?

More ›