perrygeo

3 ms·

31.
by perrygeo 1mo ago
Visualizing a sheep is not something I can even do once. Let alone repetitively until it gets boring. Being asked to visualize is quite frustrating and confusing - especially to a little kid not sure exactly what he's supposed to be &q
32.
by perrygeo 1mo ago
I thought "count sheep" just meant "please just go the f*k to sleep, kid". Literally counting sheep was too absurd. At the risk of sounding obvious, there are no sheep. No amount of trying to conjure pictures of sheep wo
33.
by perrygeo 1mo ago
I think we're in total agreement here. The $120k gets a profit for Anthropic. The $5k subscription loses money hand over fist. Somewhere in between is the real market price. And the OP is betting on a 10x reduction, from his already b
34.
by perrygeo 1mo ago
That $5k subscription is already deeply discounted by debt funding. Anthropic is losing money on that account. So the bet is this free lunch will continue indefinitely and prices are gonna drop 10x on top of that? We'll see! Put anot
35.
by perrygeo 1mo ago
Yes, scientists have put forth dire predictions of extreme weather. Here's the thhing though - we actually see measurable increases in the frequency and severity of extreme weather events. They put forth dire predictions.. and they are
36.
by perrygeo 1mo ago
> So it's not $120k/month of real money, but it's still crazy spend. I would guess I'm one of a handful of top individuals on Earth outside the frontier labs, in terms of my experience with top-end models. We get it
37.
by perrygeo 1mo ago
For research tasks, I like Meta's muse glimmer 30b model run locally. Whatever they did in post-training to make it so terse and direct, it worked. Gets right to the point and wastes no tokens. Here's a snippet from a recent think
38.
by perrygeo 1mo ago
I've come to accept that some people, when faced with impressive technology, simply want to use it. They genuinely have no interest in understanding how it works. Lately, its even become fashionable to shame people for trying to unders
39.
by perrygeo 1mo ago
> next token prediction is not searching a solution space. Interesting take. Next token prediction (via the attention mechanism) is a "walk" through the token embedding space. Searching the solution space is what it does, mathe
40.
by perrygeo 1mo ago
Yep, `/usr/bin/gdb /usr/local/bin/clisp 1337` ... also in TADC lore, windows has forward slashes.
41.
by perrygeo 1mo ago
> In The Amazing Digital Circus (episode 8, "hjsakldfhl"), when Kinger opens the terminal to try to reset Caine, you can see that Caine (a creative AI built in 1996) is programmed in Lisp. The file is literally named Caine-core
42.
by perrygeo 1mo ago
Skin in the game. Being "smart" isn't an immutable property of a noun. It's a verb. It's something you do, something you practice, constantly. Even in fields like Math where ostensibly we have universal truths acces
43.
by perrygeo 1mo ago
Coming from a more traditional stats/ML background, I try to view "thinking" traces as a way to explore the search space without getting caught in a local maximum. A better analogy for me is annealing; you can't cool met
44.
by perrygeo 1mo ago
Pasting AI slop is a strong signal. It tells the world "I add no value. I am a proxy for ideas generated by others". It's sad to see people I otherwise respected debase themselves. I'll say this clearly. Using AI for wri
45.
by perrygeo 1mo ago
> Unit and integration tests serve different purposes and one isn't necessarily better than the other. If they serve different purposes, then one is by definition better than the other, given the circumstances. There's a whole
46.
by perrygeo 1mo ago
Visceral fat really is the devil. It's not some inert glob of tissue padding your organs, it's metabolically active in all the wrong ways - increasing inflammation and insulin resistance. I've stopped worrying about weight (o
47.
by perrygeo 1mo ago
You can't assume more tokens == more value. Turns out bad ideas, amplified, just turn in to bad implementations. Github says we've 14x the number of commits this year. There is no evidence of anything close to 14x economic value b
48.
by perrygeo 1mo ago
Nope. Lactate and lactic acids are by-products of fatigue, not causal agents. Far from being toxic, elite athletes are even intentionally ingesting lactate as fuel these days.
49.
by perrygeo 1mo ago
Github's, COO Kyle Daigle, claimed that the number of commits has increased 14x since last year. So shear scale has something to do with it. I don't know of too much software already operating a planetary scale that could easily a
50.
by perrygeo 1mo ago
Mostly I'm seeing breakthroughs in the ways we use LLMs. Agentic harnesses, MCPs, etc - its the wild west still but we've come a long way from a basic chatbot. Gains are now coming from tools that make better use of the LLMs exi
51.
by perrygeo 1mo ago
When people are initially confronted with TSP and similar optimization problems, the reaction is usually awe at the shear number of potential combinations. "A 48 city tour of the continental US has 10^61 possibilities!!". Well, no
52.
by perrygeo 1mo ago
The counterweight is that Lisp syntax is tiny and regular, the language is concise, and it encourages the composition of small pure functions. There's very little context to get confused about; the code can be reasoned about locally. T
53.
by perrygeo 1mo ago
Anecdote time: I worked on a project with a senior dev who was really into unit testing and only unit testing. The software had to be fully tested as tiny little lego bricks with mocks galore. Because "if all the pieces were correct, t
54.
by perrygeo 2mo ago
Rather than good or bad engineers , I'd focus on the quality of the idea . Every software engineer has good and bad ideas. Historically, bad ideas were kept in check by the effort it would take to code the implementation. With that b
55.
by perrygeo 2mo ago
LLMs are language models. So much of this can be reduced to a simple heuristic: If you can't think clearly, LLMs will not help you. If you don't know what you're asking for or how to express it precisely, it really should n
56.
by perrygeo 2mo ago
True. Less than 40% of the world's fossil fuel energy goes to generating electricity. The rest goes to transportation, industrial processes, material feedstock, and direct heating - which are not accounted for in this metric! "Ren
57.
by perrygeo 2mo ago
Good point. I didn't mean to imply that carbon was the only value. The "services" provided by these ecosystems are incalculable. The myopic focus on carbon is an easy trap to fall into; it's the quantifiable part of th
58.
by perrygeo 2mo ago
> Just keep building... If you don't want to use AI, don't. If you want to, great. I love this sentiment. Quality should transcend the tooling used to create it. The by-hand artisan coder vs the LLM-assisted artisan coder - not
59.
by perrygeo 2mo ago
Forests and grasslands are critical for the climate because of the carbon they lock away. So long as the plants stay alive, they store carbon in the cellulose structures of roots and stems. Conserving these ecosystems is less about their da
60.
by perrygeo 2mo ago
At least this was planned ahead of time, intentionally, by the human maintainer. https://x.com/jarredsumner/status/1934822081591681353 The fear with these coding agents is that, unsupervised, one will merge a snea

More ›