singhrac

7 ms·

31.
by singhrac 1y ago
I've been doing it to Azure (private package repo) since their instructions were ok. I would like some of these to publish instructions for uv as well (instead of just pip/twine).
32.
by singhrac 1y ago
Production inference is not deterministic because of sharding (i.e. parameter weights on several GPUs on the same machine or MoE), timing-based kernel choices (e.g. torch.backends.cudnn.benchmark), or batched routing in MoEs. Probably best
33.
by singhrac 1y ago
I spent too long looking into this and settled on restic. I'm satisfied with the performance for our large repo and datasets, though we'll probably supplement it with filesystem-based backups at some point. Borg has the issue that
34.
by singhrac 1y ago
Sure, I agree. I’m just saying that most of their defacto disagreements are because of ambiguity in the specs, not because one of them is (intentionally) choosing to fork. Fwiw I think performance and features are kind of intertwined here,
35.
by singhrac 1y ago
I think you have 2 issues with content based systems: you have ambiguity (in archiving and retrieval) and you have to use mental effort to resolve that ambiguity. The Dewey decimal system has less ambiguity in both, and an alphabetical syst
36.
by singhrac 1y ago
Sure, but in this case they are both implementations of a spec defined by PEPs, so a bit more like gcc vs clang (less tightly bound than those, of course, in design decisions). Neither company is trying to invent a new language here.
37.
by singhrac 1y ago
I think they've mentioned earlier that it's really just because PyCon is this week (so a good time to announce new Python tooling).
38.
by singhrac 1y ago
Here's a very small piece of I code I generated quickly (i.e. <5 min) for a small task (I generated some data and wanted to check the best way to compress it): https://gist.github.com/rachtsingh/e3d2e2b495d631b7
39.
by singhrac 1y ago
There’s nothing quite like writing the final squashed commit message and saying “results should be bit-level identical, +25% speedup on average” or the equivalent. Even better if it’s a hot path that matters to the bottom line of the compan
40.
by singhrac 1y ago
Well, I mean why use a suboptimal tool? I don’t have any ideology to follow, my codebase is just mostly Python and heavily typed. Pyright doesn’t support all the features so I stick with VSCode/Pylance.
41.
by singhrac 1y ago
At least the alpha milestone is May 12, but I don't think they've publically committed to anything. In particular for me it would be great to have a better typechecker than Pyright available for Zed (basically why the editor is a
42.
by singhrac 1y ago
Can you choose a model via the Gemini app? I can on the webapp (finally), but on the mobile app it won’t let me choose. Using Gemini via Google Workspace.
43.
by singhrac 1y ago
Yes, this is pretty much what Hetzner must have built with their object storage - and they get to 5 EUR/month, so really close to Backblaze pricing.
44.
by singhrac 2y ago
I'm having a bit of a Gell-Mann moment here - I'm hearing the exact opposite from every residential and C&I installer I talk to, that solar installations are booming right now. There are very few states in the US where net met
45.
by singhrac 2y ago
Eh, I write a lot of Python and while it's unnecessary, it can make code easier to read if not overused. if (config_fn := base_dir / "config").exists(): ... is just a tiny bit shorter than this: config_f
46.
by singhrac 2y ago
I want to argue that graphics cards are really 3 markets: integrated, gaming (dedicated), and compute. Not only do these have different hardware (fixed function, ray tracing cores, etc.) but also different programming and (importantly) dist
47.
by singhrac 2y ago
That's pretty surprising and breaks my mental model of how these chips perform. Do you think that's because they don't have the raw FLOPs, something inefficient in the Apple/Metal rendering pipeline, something about Civ
48.
by singhrac 2y ago
It is really nice, I'm very sad that Apple's RDP implementations seem fragmented and difficult to use. I've tried a few times with my Mac Mini, and it just doesn't seem to work that well.
49.
by singhrac 2y ago
I have spent a lot of hours looking at `watch "xsv select ... | xsv table"`.
50.
by singhrac 2y ago
Do you have a roadmap? I'm interested (love Linear, hate Quickbooks/Xero, looking for something better, finances are not that complicated) but I want to know what is planned and what is supported now.
51.
by singhrac 2y ago
I use fd all the time. I admit it, I couldn't get the muscle memory right for find. One day I'll be on a bare Linux installation where I can't cargo install whatever I want and I'll have to ask ChatGPT to generate my fin
52.
by singhrac 2y ago
Sigh, there is a lot of misinformation about this and higher education tuition. * It’s not a new policy, when I went to school the same threshold was ~$150k * It’s not a step function, it’s a sliding scale (with <0 tuition, i.e. cost-of-
53.
by singhrac 2y ago
I mean, it is covered by mainstream media. There’s like 4 articles on it in the last year in the NYT. Here’s one: https://www.nytimes.com/2024/08/29/opinion/el-salvador-safet...
54.
by singhrac 2y ago
Ghost as an alternative? They’ll let you sign up paying subscribers as well.
55.
by singhrac 2y ago
There's some rumors of an Arc Pro, which would be a B580 in clamshell configuration with 24 GB of VRAM (which iiuc would be the same memory bandwidth unfortunately). Unless the price is absurd it would be the cheapest dollar/VRAM
56.
by singhrac 2y ago
This works on my personal Google account, but not on my workspace one. So I guess there's no access to 2.0 Pro then? I'm ok trying out Flash for now and see if it fixes the mistakes I ran into yesterday. Edit: it does not. It cont
57.
by singhrac 2y ago
I just tried it but nothing happens when I click on that. You're talking about the thing on the upper left next to the open/close menu button?
58.
by singhrac 2y ago
What is the model I get at gemini.google.com (i.e. through my Workspace subscription)? It says "Gemini Advanced" but there are no other details. No model selection option. I find the lack of clarity very frustrating. If I want to
59.
by singhrac 2y ago
You can decorate a function with @torch.compiler.disable() to disable a specific function (and anything further down the call stack).
60.
by singhrac 2y ago
I was a longtime user of Sublime Text and switched to VSCode because of Remote Development and Pylance. Everything else is pretty much fine and Sublime has always had better performance, though these days having support for AI integration (

More ›