inciampati

8 ms·

61.
by inciampati 2y ago
What's the best technique to train the model to stop responding? A bit of fine tuning on texts with EOS markers?
62.
by inciampati 2y ago
An example, which is interesting, in which "deep" networks are necessary, is discussed in this fascinating and popular recent paper on RNNs [1]. Despite the fact that the minGRU and minLSTM models they propose don't explicitl
63.
by inciampati 2y ago
And I'd love to see data compression terminology get an overhaul. Do we need big LLMs or just succinct data structures? Or maybe "compact" would be good enough? (Yeah LLMs are cool but why not just, you know, losslessly compr
64.
by inciampati 2y ago
I recently had a friend-of-a-friend's apple seed liquor. It smelled of almonds...
65.
by inciampati 2y ago
I'm impressed by how many people who are working with Claude Code seem to have never heard of its open source inspiration, aider: https://aider.chat/ It's exactly what Yegge describes. It runs in the terminal, off
66.
by inciampati 2y ago
Aider does scan your entire codebase. What did you try to do that didn't work? A typical workflow for me involves developing a plan document using copy/paste from the command line into a (cheap/fixed cost) webui and discussin
67.
by inciampati 2y ago
I'm impressed by how many people who are working with Claude Code seem to have never heard of its open source inspiration, aider: https://aider.chat/ It's exactly what Yegge describes. It runs in the terminal, off
68.
by inciampati 2y ago
IIRC hair dying is not great during pregnancy. It is slightly, but measurably oncogenic in children of mothers who died hair during pregnancy and breastfeeding. https://pmc.ncbi.nlm.nih.gov/articles/PMC3543291/
69.
by inciampati 2y ago
Genetic diversity is a scientifically measurable feature of an organism or population, often diversity is stylized as π. I've heard of grants that mention this diversity in terms of mouse populations which are currently frozen. The sol
70.
by inciampati 2y ago
It seems that people in these kinds of positions feel very powerless, frustrated, and cranky. And they love to vote for posts that say these kinds of things. They validate the frustration that they experience working in these enterprise env
71.
by inciampati 2y ago
by giving the models durable memory, they become "agentic". in any case, they don't make as much of a mess when their output is getting written into git.
72.
by inciampati 2y ago
Weirdly they didn't test nighttime exposure as an intervention. OK, "weird" means probably it was costly/hard to get people into a lab setting at 9pm... But it does make you wonder!
73.
by inciampati 2y ago
To date there is no evidence that any court order has been respected. The crisis continues.
74.
by inciampati 2y ago
It's thanks to this kind of guidance that HN survives as a focused technical hivemind. At the same time, issues of this kind of revolutionary scope are important for users to process. We can learn a lot from each other. Irrespective of
75.
OpenAI's o1 and o3 models forget what they thought(platform.openai.com)
1 points by inciampati 2y ago|1 comments
76.
by inciampati 2y ago
Reasoning models from OpenAI forget what their past reasoning. The reasoning tokens are removed from context after the user-visible response is generated. It's not what I expected, given that memory of reasoning is the key to chain or
77.
by inciampati 2y ago
LLMs are actually the new computers. Compilation is only one program they can run.
78.
by inciampati 2y ago
o-whatever are doing the same thing as any LLM, it's merely that they've been tuned into using a chain of thought to break out of their complexity class (from pattern matching TC0 to pseudo-UTM). But any foundation model with a bi
79.
by inciampati 2y ago
LLMs (transformers) literally cannot balance parentheses. That's outside of their complexity class (TC0). You'd want a real UTM to count parentheses!
80.
by inciampati 2y ago
> Is this a case of PEBKAC? It's 2025 and every useful conversation with an LLM ends with context exhaustion. There are those who argue this is a feature and not a bug. Or that the context lengths we have are enough. I think they la
81.
by inciampati 2y ago
This has been said by every long term user of these sites. And not at the same time. It was always better in the past. It's probably partly true... yeah, quality can decrease as things get better. But it's also partly an illusion
82.
by inciampati 2y ago
This is so good! Finally the word I need to describe what I'm living. And yes I'm copy pasting articles into LLMs for summary.
83.
by inciampati 2y ago
Well, part of the reason that this writeup doesn't mention the brain is that the author is ignorant of precise details of how the brain works, and chose not to speculate :) Which is exactly why these papers are such a useful reading li
84.
by inciampati 2y ago
I wrote this after spending December thinking about why o3's expensive memory usage matters. The key insight feels trivial (CS101: universal computation needs stable state + memory), but watching xAI (and now Stargate) build gigawatt f
85.
Memory makes computation universal, remember?(thinks.lol)
2 points by inciampati 2y ago|1 comments
86.
by inciampati 2y ago
Wonderful! Thanks, I'll definitely read the Maturana and Valera work, would be good to work through this line of thinking.
87.
Memory makes computation universal, remember?(thinks.lol)
5 points by inciampati 2y ago|5 comments
88.
What CRISPR, O3, and the Memphis Plume Show Us About Intelligence(thinks.lol)
3 points by inciampati 2y ago|0 comments
89.
by inciampati 2y ago
https://platform.openai.com/docs/guides/reasoning/advice-on-... this explains the bug. o1 can't see its past thinking. This would seem to limit the expressivity of the chain of thought. Maybe within one
90.
by inciampati 2y ago
I found this documentation from openai that supports my hunch: https://platform.openai.com/docs/guides/reasoning/advice-on-... The reasoning tokens from each step are lost. And there is no indication that the

More ›