samsartor

11 ms·

31.
by samsartor 2y ago
Worth clarifying that you are talking about information content, not entropy. A single text file or png has information, the distribution of all possible text files or all possible pngs has entropy. I'm not an expert, but let me brains
32.
by samsartor 2y ago
None of the images load for me. The site is https but the srcset attributes all use http. Ironically the src attributes are correct.
33.
by samsartor 2y ago
Removing impl Drop is like removing a function from your C API (or removing any other trait impl): something library authors have to worry about to maintain backwards compatibility with older versions of their library. A surprising amount o
34.
by samsartor 2y ago
The video gets into that. The main purpose is to verify that the binary you're running came from the actual source code.
35.
by samsartor 2y ago
Dependent typing is mainly just that feature of Typescript that `x: number | null` becomes just `x: number` inside an `if (x != null) { ... }` statement. If you dig deeper into the type theory, it gets really interesting and complicated bec
36.
by samsartor 2y ago
I think it's also generally understood that Nvidia owns the training space, but not the inference space. They have a lot more competition there and the margins are smaller. More people running AI models is still good for them, but a dr
37.
by samsartor 2y ago
Good point. I agree actually, many people do put the work in to understand the whole stack. But one person could not have built the whole thing themselves obviously. All I was trying to say is we already live with superhuman intelligences e
38.
by samsartor 2y ago
Nope, not my point. My point was that even if we get superhuman AGI, the effect of self-improvement may not be that large.
39.
by samsartor 2y ago
I think we are already way past single-human intellence. No one person understands (or could possibly understand) the whole system from the silicon up. Even if you had one AI "person" a 100x smarter than their coworkers, who can s
40.
by samsartor 2y ago
All past data shows is exponential growth in the cost of AI systems, not an exponential growth in capability. Capabilities have certainly expanded, but that is hard to measure. The growth curve is just as likely to be sigmoid-shaped. Just a
41.
by samsartor 2y ago
That could be the VAE? The "latent" part of latent diffusion models is surprisingly lossy. And however much the image is getting inpainted, the entire thing gets encoded and decoded. Edit: I'll note some new models (SD3 and F
42.
by samsartor 2y ago
A lot of current inpainting models have quite a lot of "signal leak". They're more for covering stuff vs removing it entirely. Ironically, some older SD1/2-era models work a lot better for complete removal.
43.
by samsartor 2y ago
I tried Axum recently and had a fairly bad experience. Incomprehensible trait errors, generics all over the place, and mind-numbing async glue code. Salvo wound up being way more straightforward for my (admittedly simple) use case. I haven&
44.
by samsartor 2y ago
GNNs have been a bit of a disappointment to me. I've tried to apply them a couple times to my research but it has never worked out. For a long time GNNs were pitched as a generalization of CNNs. But CNNs are more powerful because the &
45.
by samsartor 2y ago
Reminder that Rust does not automatically schedule anything. Unless you _explicitly_ call `tokio::spawn` or `async_std::spawn` you are still living entirely in state-machine land. Rust's `join_all` uses `FuturesUnordered` behind the sc
46.
by samsartor 2y ago
Anyone who works closely with diffusion models knows the "world model" thing was hype. Diffusion models are really good at faking, starting with nonsensical large-scale structure and forcing it towards plausibility with lots of ni
47.
by samsartor 2y ago
Not for all intents and purposes. If we are asking whether MOND is useful, then the answer is probably yes. You might use it for simulations of galaxy formation where Newtonian gravity is considered a reasonable approximation today. But MON
48.
by samsartor 2y ago
https://en.wikipedia.org/wiki/Tests_of_general_relativity#Pe... is the example I learned in school. You don't need to be around a black hole for GR to suddenly switch on. Newtonian gravity is an approximation. A p
49.
by samsartor 2y ago
TeVeS is definitely interesting, but it still has problems like you said. AFAICT gravitational wave observations are particularly bad for TeVeS theories. TeVeS isn't dead, but if dark matter theories are criticized for being patched up
50.
by samsartor 2y ago
My hangup with MOND is still general relativity. We know for a fact that gravity is _not_ Newtonian, that the inverse square law does not hold. Any model of gravity based on an inverse law is simply wrong. Another comment linked to https:&
51.
by samsartor 2y ago
Instead of psql, I really like https://github.com/dbcli/pgcli
52.
by samsartor 2y ago
I think I'd be willing to accept software patents if the patent was required to include complete source code. Basically, if it acted as delayed open source. Ostensibly the patent system exists to incentivize open publishing of new tech
53.
by samsartor 2y ago
For problem #3, I think you can also prove it with perspective. The 3 circles are identical unit spheres at different distances from the viewer. The spheres are connected by 3 infinite cylinders. The cylinders form a triangle, and so lie on
54.
by samsartor 2y ago
Imperative rust is really good for parsing, but you can also get a long way with regexes. Especially if you are just prototyping or doing Advent of Code. I do still like declarative parsing over imperative, so I wrote https://doc
55.
by samsartor 2y ago
My advisor also worked on this ML project for estimating electron density and temperature within tokomaks: https://www.cs.wm.edu/~ppeers/showPublication.php?id=Ozturk:... Technically that counts as "AI in nuclear
56.
by samsartor 2y ago
Unfortunately first-past-the-post was on the ballot in a lot of states this year, and absolutely crushed ranked-choice: https://ballotpedia.org/Ranked-choice_voting_(RCV)#Ballot_me... I live in Colorado and couldn't be
57.
by samsartor 2y ago
Right now the only arguments to Future::poll are self and the task scheduler context. Any borrows of mutable state have to be captured by self, which means only one future with access to the state can be inflight at a time. If `&mut Sta
58.
by samsartor 2y ago
Actors in Rust still kind of suck because there are no first-class resume arguments. In order to provide a `&mut State` you have to either: - handle messages sequentially per-actor (like Ractor, and like Bastion in practice) - create yo
59.
by samsartor 2y ago
Sorta, in classical single-bounce ray tracing you still need to cast explicit shadow rays from diffuse surfaces. Path tracing gives shadows for free, because it is simulating global illumination rit large: ambient occlusion, shadows, bounce
60.
by samsartor 2y ago
SketchUp uses stencil shadows! Although we have more modern options, it is part of the look.

More ›