charles_irl

6 ms·

31.
Modal Notebooks: How we built a cloud GPU notebook that boots in seconds(modal.com)
4 points by charles_irl 1y ago|0 comments
32.
Public static void main(String[] args) is dead(mccue.dev)
210 points by charles_irl 1y ago|203 comments
33.
Why Are Event-Driven Systems Hard?(newsletter.scalablethread.com)
4 points by charles_irl 1y ago|2 comments
34.
Safe C++ proposal is not being continued(sibellavia.lol)
184 points by charles_irl 1y ago|223 comments
35.
The unreasonable effectiveness of modern sort algorithms(github.com)
6 points by charles_irl 1y ago|0 comments
36.
by charles_irl 1y ago
Cool paper! The authors use the fact that the M1 chip supports both ARM's weaker memory consistency model and x86's total order to investigate the performance hit from using the latter, ceteris paribus. They see an average of 10%
37.
Analyzing the memory ordering models of the Apple M1(sciencedirect.com)
131 points by charles_irl 1y ago|69 comments
38.
by charles_irl 1y ago
Author here! Worked on this project generating QR codes with diffusion models and ensuring they actually scan. Ended up having to manually scan a few thousand generated codes by hand in order to build up a dataset to evaluate fully automate
39.
Generating diffusion QR codes that work(modal.com)
5 points by charles_irl 1y ago|2 comments
40.
by charles_irl 1y ago
That's a fair point! I was thinking of the Yamaha chips in the Sega consoles mentioned in that comment -- which certainly defined the sound of the 1990s for me as a child. But my small town Midwestern up-bringing was behind the curve!
41.
by charles_irl 1y ago
We looked into this at Modal! We put out vGPUs but didn't see demand and our internal benchmarks for MPS and Green Contexts didn't indicate a big win. The tricky thing here is that many GPU workloads saturate at least one of the r
42.
by charles_irl 1y ago
When I'm feeling sassy, I like to tell people that Modal is "Enterprise Java Beans for AI".
43.
by charles_irl 1y ago
We've talked to them and there's some impressive technology there!
44.
by charles_irl 1y ago
Hmm, hard to say! In the few months since I originally wrote this, I've come to an even greater appreciation of just how hard it is to maximize utilization of the Tensor Cores. It's a lot more than just kernel parameter tuning and
45.
by charles_irl 1y ago
Nice article! I had to restrain myself from ranting on our blog :)
46.
by charles_irl 1y ago
Oh, I wrote this! Thanks for sharing it.
47.
by charles_irl 2y ago
I worked on this project a bit! These are great questions. Fine-tuning works very well for style (as opposed to factual knowledge), which is all we're trying to achieve here -- as another commenter put it, it's a "comedy bit&
48.
by charles_irl 2y ago
Thanks! We think that just because something is deeply technical doesn't mean it has to be ugly.
49.
by charles_irl 2y ago
Coming from the neural network world, rather than the shader world, but: I'd say you're absolutely right! Right now NNs and their workloads are changing quickly enough that people tend to prefer runtime optimization (like the dyna
50.
by charles_irl 2y ago
Thanks for the kind words! I still feel like one of those newcomers myself :) Now that so many more people are running workloads, including critical ones, on GPUs, it feels much more important that a base level of knowledge and intuition is
51.
by charles_irl 2y ago
100% -- there's basically no substitue for benchmarking! I find the empiricism kind of comforting, coming from a research science background. IIUC, even CuBLAS basically just uses a bunch of heuristics that are mostly derived from benc
52.
by charles_irl 2y ago
Yeah, there's a tension between showing enough information to be useful for driving decisions and hiding enough information. For example, "compute capability" sounds like it'd be what you need, but it's actually mor
53.
by charles_irl 2y ago
A few seconds is way longer than we intended! When I click around all pages after the first load in milliseconds. Do you have any script blockers, browser cache settings, or extensions that might mess with navigation? > would also like t
54.
by charles_irl 2y ago
Good callout! I'll work on the captions.
55.
by charles_irl 2y ago
Custom! Took inspiration from lynx, lotus, and other classic terminal programs.
56.
by charles_irl 2y ago
Thanks! > intels SMT does do something very similar (2 hw threads) Yeah that's a good point. One thing I learned from looking at both hardware stacks more closely was that they aren't as different as they seem at first -- lots
57.
by charles_irl 2y ago
Great idea! We'll add some of those in the next round.
58.
by charles_irl 2y ago
Oh hey, I wrote this! Thanks for sharing it.
59.
by charles_irl 2y ago
One of the authors, Charles, here. I wrote this up because 1) I've been following work on sampling/inference-time compute scaling and the "Large Language Monkeys" paper ( https://arxiv.org/abs/2407.21