sakras

8 ms·

31.
by sakras 2y ago
I figured this was pretty obvious given that MLPs are universal function approximators. A giant MLP could achieve the same results as a transformer. The problem is the scale - we can’t train a big enough MLP. Transformers are a performance
32.
by sakras 2y ago
What really made HNSW click for me was when someone described it as a "skiplist graph". It really does seem to share a lot of the same properties and intuition as a simple skiplist, where descending levels corresponds to finer-gra
33.
by sakras 2y ago
I think OP wanted to construct “sand by induction”, but I also think you need more than one grain. If you have 9 grains of sand and add one snowflake, you now have something that’s 90% sand and is therefore 10 grains of sand. Take your 10 g
34.
by sakras 2y ago
I really enjoyed playing that! Just did the frog and the eye :) Seems like a good thing to mindlessly do for fun
35.
by sakras 2y ago
Basically, quantum gates are mathematically represented as multiplying your state by unitary matrices. Unitary matrices are ones where their inverse is their own conjugate transpose (i.e. XX*=I). Since each gate has an inverse, for any comp
36.
by sakras 2y ago
Would highly recommend Zero engine - it was used by DigiPen for their summer camps (which I attended)! The scripting language is a custom one called Zilch, but it should be straightforward to pick up if you know JavaScript. https:/&#x
37.
by sakras 2y ago
There are a lot of steps involved in making the chips - lithography is only one of them. You have to have the supply chains set up for massive amounts of silicon, you have to have a process for doping the silicon properly, you need quality
38.
by sakras 2y ago
Am I understanding correctly that they are proposing to add Rust to only userspace packages, not the kernel like in Linux? I guess the real limitation then is that the base system is built in tandem with the kernel, unlike in Linux.
39.
by sakras 2y ago
They operate in somewhat different domains - numpy is to numerical data as pyarrow is to dataframe data. This means Arrow has strings, maps, nested types, etc. Note that I compared to pyarrow and not Arrow - Arrow refers to the arrangement
40.
by sakras 2y ago
Well, the array of Umbra strings will almost certainly be aligned to 16-bytes, since each string view is a fixed 16 bytes. For the secondary buffer containing long strings, they would not have any particular alignment because they contain b
41.
by sakras 2y ago
Wow I didn’t know the old bridge was such a nightmare. This also makes me wonder why this line only opened now, if it was voted on all the way back in 2008. I do usually take the 542 now, and it works well-enough, but it only comes every 30
42.
by sakras 2y ago
And then them making to along I-90 instead of 520 also doesn't make a whole lot of sense. I'd LOVE a fast line from the east side to U-district. But I don't understand the logic behind the current scheme.
43.
by sakras 2y ago
Unfortunately not :) On a given implementation of C, a pointer has some specific size (let's call it S). This means that we can address 2^S bytes of memory. Each byte has CHAR_BIT bits, so can be in 2^CHAR_BIT states, meaning we have 2
44.
by sakras 2y ago
TimescaleDB's $110M series C would like to have a word :)
45.
by sakras 2y ago
Ah also the multiplication operation isn't commutative, since struct { int A; float B; } is different from struct { float A; int B; }. So maybe it's a "noncommutative semiring".
46.
by sakras 2y ago
> Let’s pause for a moment to remember that we’re dealing with types. And the expression 1 / (1 - a) contains both a negative and a fractional type, neither of which have a meaning yet. This makes me wonder, is there a ring of types
47.
Not Speeding Up Delta Decoding with Value Speculation(save-buffer.github.io)
1 points by sakras 2y ago|0 comments
48.
by sakras 2y ago
One question I always have about these sorts of translation layers is how they deal with the different warp sizes. I'd imagine a lot of CUDA code relies on 32-wide warps, while as far as I know AMD tends to have 64-wide warps. Is there
49.
by sakras 2y ago
The demo fell a little flat because the "before parallel DOM" and "after parallel DOM" boxes were almost exactly in sync for me (Firefox, MacOS).
50.
by sakras 2y ago
Essentially, unless you `fsync`, there's no guarantee that your data will be durably written to disk. This is because the operating system keeps data buffered in in-memory caches, so if the machine crashes you may lose some data. The `
51.
by sakras 2y ago
Yep - it's an exact copy at the page level, so _everything_ is copied. Regarding data anonymization, you can use the pg_anon extension on your branch. There's a blog post about it: https://neon.tech/blog/easil
52.
by sakras 2y ago
Disclaimer: I work at Neon Neon makes this very ergonomic in a cloud setting (actually it works somewhat similarly to how the article does it). You can create a copy-on-write version of your prod database (a branch) and use it for testing.
53.
by sakras 2y ago
This was fun, I went into this thinking "Ha I already know this theorem" but came out learning something about zero knowledge proofs!
54.
by sakras 2y ago
I started reading it around a year ago with the personal goal of doing every exercise. I'm not done yet (almost done with chapter 4). It has definitely taken a lot of my time, but it really has changed my thinking about a lot of langua
55.
by sakras 2y ago
Is it an innate property of humans that the curly-brace style is more natural? I wonder if in an alternate universe where Lisp took off as the browser language people would find it more natural instead. It seems like somewhat of a chicken-e
56.
by sakras 2y ago
I wrote a blog post about how we can use ideas from the HPC community to gauge how fast a query should run, and how we should compare databases to each other. Happy to answer any questions
57.
Is your database fully using your hardware?(save-buffer.github.io)
3 points by sakras 2y ago|1 comments
58.
by sakras 2y ago
This is very cool! My first thought is: can this be applied to converting raster graphics to vector graphics (eg PNG to SVG)? Seems like a very similar problem, though probably much more computationally expensive.
59.
by sakras 2y ago
It's honestly my most enjoyed game of the last few years. The feeling of boarding the Pelican right at the end of the mission never gets old.
60.
by sakras 2y ago
My real showstopper with Hare is the lack of multithreading. In the modern world, we need to be making parallelism easier not harder!

More ›