sheafification

3 ms·

1.
by sheafification 6d ago
If that’s your standard for what counts as prediction, Asimov beat him to it by seventy-ish years. EDIT: > Scott made comments on a specific emerging technology He was speculating on what would happen if one gave GPT-2 “near-infinite tra
2.
by sheafification 6d ago
The context shows he was simply whining about AGI skeptics back in 2018, and many of the “predictions” he makes in that paragraph (including the one you quoted) are trivially wrong because he phrased them so hyperbolically and categorically
3.
by sheafification 6d ago
I’m not seeing anything like a falsifiable prediction that LLMs will write math proofs in that article. I see a thought experiment about giving GPT-2 “near-infinite training data and [compute]” but that’s not falsifiable. That’s also not ho
4.
by sheafification 9d ago
I’m inclined to agree. Sometimes when (perhaps other) people say this there’s an undertone of “and the field is full of not-real mathematicians” as if there’s a large contingent just hanging on for the money or prestige, and I personally ha
5.
by sheafification 10d ago
True, 2D Poisson is only approximately banded. Still, I don’t think I’d bother rolling my own sparse solver. It’s a well-trod problem.
6.
by sheafification 10d ago
I doubt outside of a few exceptional cases that one is going to do better on CPU-bound problems than a well-written LAPACK implementation built for the architecture you intend to run on. Maybe pedagogy was the point? I didn’t really get tha
7.
by sheafification 10d ago
Various algebras of dual numbers are used in most automatic derivative routines. This is treated more rigorously and generically in the subject of synthetic differential geometry.
8.
by sheafification 13d ago
I remember learning about that from Stephenson’s Cryptonomicon , back in the day. It’s not even a US-specific thing. Many countries recruit foreigners to their militaries. https://en.wikipedia.org/wiki/List_of_militari
9.
by sheafification 14d ago
> Technically a large landmass, but essentially nothing happens in the western half. Depends what you mean by "western half," I suppose, but China is definitely not a relatively small country. Shanghai to Chongqing is about the
10.
by sheafification 18d ago
I hate the dark forest more than just about any scifi trope but reality just keeps proving it right.
11.
by sheafification 24d ago
This is very sad, but I came to the same conclusion with my math blogging a couple years back. There’s little point to publishing any personal effort on the internet anymore. At best you get some spam comments and your work stolen by bot sc
12.
by sheafification 26d ago
My go-to is “It’s the only thing I was good at in school, I was hopeless at everything else,” which is only a slight exaggeration.
13.
by sheafification 26d ago
It’s highly nontrivial to verify that a 250k loc Lean program actually represents that which it claims. I guess it could be AI turtles checking and summarizing all the way down, but is that any more credible than a single AI checking it? I
14.
by sheafification 26d ago
> do you expect this to remain true? If so, for how long? For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback