winwang

14 ms·

211.
by winwang 2y ago
Alright, so we're spherical cow-philosophers... (jk, I like your point!)
212.
by winwang 2y ago
4090 tensor performance (FP8): 660 teraflops, 1320 "with sparsity" (i.e. max theoretical with zeroes in the right places). https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvid... But at
213.
by winwang 2y ago
There was a script I once saw for Twitter where it blocked all users within some follower/followee radius of a set group of people. For public discourse, I wonder what the right level of agreeable "echo-chambering" is.
214.
by winwang 2y ago
The power of having an API that allows usage of the Free monad. And in less-funny-FP-speak, the power of allowing the user write a program (expressions), that the sufficiently-smart backend later compiles/interprets. Awesome! Didn&#x
215.
by winwang 2y ago
I was following you up until that first comma.
216.
by winwang 2y ago
The controller being decoupled is an extremely interesting idea! Makes a lot of sense. I wonder if it includes a (nontrivial) cache.
217.
by winwang 2y ago
Until I get around to it, there's this blog post I wrote: https://wiwa.substack.com/p/can-we-10x-rust-hashmap-throughp... Not an "expert" on GPU hash tables, but I'm mildly aware of other hashmap th
218.
by winwang 2y ago
Makes me consider writing a post on misconceptions of GPU computing, such as requiring the problem to be fully data-parallel.
219.
by winwang 2y ago
Two programs which are semantically equivalent are not simply the same. See: bubblesort vs mergesort. (Yes I'm relying on curry-howard isomorphism here).
220.
Ask HN: People using BigQuery for data ingestion, biggest pain points?
2 points by winwang 2y ago|0 comments
221.
by winwang 2y ago
Didn't know Steve Blank was looking at quantum computing! That's cool. I had a brief run-in with error-correcting gates. My research topic was about a simple bit-flip operation (quantum dot qubits) under random "telegraph&quo
222.
by winwang 2y ago
Hmm, I should say "the numerical value of pi in base 10" (or really any rational base), even if we were to weaken that with the qualifier "a to arbitrary degree of precision". We know pi in the sense of "a unique re
223.
by winwang 2y ago
Considering that we don't know the value of pi (not that we could write it out nor read it), I'm not sure your definition of "measure" is the same as mine or most people's.
224.
by winwang 2y ago
Yeah, that makes sense now. I think, personally, I've simply seen that design around a bunch, but great on you to question it and call it out -- also plausible that my own headcanon doesn't check out.
225.
by winwang 2y ago
I like your take, and I propose there is another kind of division: function "coloring". An async "effect" type (e.g. futures, or even just 'async function') signals to programmers that there is some concurrency
226.
by winwang 2y ago
Only semi-relevant, but there's also the fact that lower level languages can auto-optimize more deeply -- but that's also more my intuition (would love to get learnt if I'm wrong). For example, I'd expect that Rust (or r
227.
by winwang 2y ago
Curious what you mean by "most" (I'm agnostic/unlearned on the statistics tbh). I "feel" like it doesn't happen too often when it's not either already low-level or the supposed extra performance is li
228.
by winwang 2y ago
Conclusion noted: nuke the whales before they nuke us. (/s)
229.
by winwang 2y ago
I mean, the QKV part of transformers is like an "ASIC" ... well, for an (approximate) lookup table. (also important to note that NNs/LLMs operate on... abstract vectors, not "language" -- not relevant as a response
230.
by winwang 2y ago
Everything you're saying is plausibly possible in the absurdly large search space of all possible scenarios. The author's premise, however, is rooted in the specific scenario they lay out, with historical supporting examples which
231.
by winwang 2y ago
The rack could go down from the point of view of the storage service, but the machine/VM itself could be perfectly fine.
232.
by winwang 2y ago
What if the rack goes down? But I think the author is saying a similar thing to you. The fenced token is essentially asserting that the client will no longer rely on the lock, even if it tries to. The difference is the service doesn't
233.
by winwang 2y ago
This isn't a mutex, but the distributed equivalent of one. The storage service is the one who invalidates the lock on their side. The client won't detect its own issues without additional guarantees not given (supposedly) by Redlo
234.
by winwang 2y ago
thank you for the education :) this is so good!
235.
by winwang 2y ago
Can anecdotally confirm as a data point myself along with some people I know. Certainly, I can be viewed as stereotypically successful by my buddies. Certainly, because the mask we wear should be strong and never come off. But in my nights
236.
by winwang 2y ago
I'm not sure if the maths are related, but there is a different (though similar) idea in gravitational slingshots. It's not the same because it simply uses "normal" linear momentum. But I also only read the abstract, lol
237.
by winwang 2y ago
Very interesting! I'd love to see discussion about how game theory/mechanism design could help with "marketplaces" like this!
238.
by winwang 2y ago
something something wings are air-legs
239.
by winwang 2y ago
Dang! I was gonna (lol) write an HM-in-python post, also via my experiences at Recurse Center! In other news, great to see another Recurser :)
240.
by winwang 2y ago
Same, except the last point, I feel like I've seen that pattern multiple times. And it's not like it's expensive to do (presumably unless you get sued or something).

More ›