usernametaken29

8 ms·

151.
by usernametaken29 6mo ago
Make yourself useful to the right people at the right time. Pretty quickly you’ll be able to work across many teams on many problems. This is cool because in a startup you simply don’t get the same amount of exposure. It’s always the same p
152.
by usernametaken29 6mo ago
Actually we know this for a long time. The universal approximation theorem states that any arbitrary function can be modelled through a nonlinear basis function so long as capacity is big enough. The practical bit here is knowing how many b
153.
by usernametaken29 6mo ago
I was going to say this is rich…
154.
by usernametaken29 6mo ago
Couldn’t read the blog post over the obnoxious amount of ads. Sad
155.
by usernametaken29 6mo ago
I have used SQLite with extensions in extreme throughput scenarios. We’re talking running through it millions of documents per second in order to do disambiguation. I won’t say this wouldn’t have been possible with a remote server, but it w
156.
by usernametaken29 7mo ago
I think personally the unit you measure divergence in just doesn’t matter. Yes, nats is technically superior, but as long as you do it consistently, all that you really want to do is to measure how similar A is to B. In that sense I think m
157.
by usernametaken29 7mo ago
Just say you’re training a multimodal language model and in this weird parallel universe we live in suddenly you’re not breaking copyright. Bonus points if your model reproduces the original 1:1. Definitely not a copy though
158.
by usernametaken29 7mo ago
Only that one is built to be deterministic and one is built to be probabilistic. Sure, you can technically force determinism but it is going to be very hard. Even just making sure your GPU is indeed doing what it should be doing is going to
159.
by usernametaken29 7mo ago
If you ask me the quickest way to explain KL divergence is like such: If two distributions are the same KL becomes 0. KL quantifies how many nats of difference there is between a target and a source. It’s always good to read through the ori
160.
by usernametaken29 7mo ago
Actually at a hardware level floating point operations are not associative. So even with temperature of 0 you’re not mathematically guaranteed the same response. Hence, not deterministic.