dawnofdusk

11 ms·

91.
by dawnofdusk 3y ago
The paper offers a reason why NNs working for tabular data would be good: >Creating tabular-specific deep learning architectures is a very active area of research (see section 2) given that tree-based models are not differentiable, and t
92.
by dawnofdusk 3y ago
First principles doesn't mean easy to read unfortunately
93.
by dawnofdusk 3y ago
Depends on what you want from a (text)book. In my mind books should be authoritative, they should include things that have had some thought put into them and are fairly well studied/verified. Modern advances in deep learning/ML ar
94.
by dawnofdusk 3y ago
Enough of this strawman one-liner "complexity for the sake of complexity". Unnecessary complexity is introduced because someone once thought it was necessary. It may not be necessary anymore, or (even worse) it might have not even
95.
by dawnofdusk 3y ago
>they'll talk about the "structure" of the position, and then confirm the structure via some amount of search Yes that's sort of the point of the approach. Imagine when the board is any position, you have a list of al
96.
by dawnofdusk 3y ago
It doesn't get the actual optimal Q values computed from Stockfish (presumably this takes infinite compute to calculate), in fact it gets computed estimates from polling Stockfish for only 50ms. So you're estimating from data a fu
97.
by dawnofdusk 3y ago
Even if it's "implicit" I'm not sure if that matters that much. The point is that the model doesn't explicitly search anything, it just applies the learned transformation. If the weights of the learned transformatio
98.
by dawnofdusk 3y ago
Skimmed some of the articles, particularly those nearer to my field. Seems like a generally good set of informal notes. Random comments: >when the states evolve in time and the observables don’t we are using Liouville’s picture; when the
99.
by dawnofdusk 3y ago
>Is there a translation of this into category theory terms? It's essentially the same as the relation between covariance and contravariance in category theory.
100.
by dawnofdusk 3y ago
For runners and other athletes (depending on the sport), it seems fairly useful. I struggle to think of other use cases that justify it. Obviously, a smart watch is strictly better than a regular watch in the sense that it has more features
101.
by dawnofdusk 3y ago
It is a good thing for deep NNs to be expressive enough to do this, because it is this level of expressivity that let's it find answers to otherwise ill-posed problems. If it were not able to do this there would be no point in using th
102.
by dawnofdusk 3y ago
This is one of the cool things about various neural network architectures that I've found in my own work: you can make a lot of dumb mistakes in coding certain aspects but because the model has so many degrees of freedom it can actuall
103.
by dawnofdusk 3y ago
Nice blog. I'll be provocative/pedantic for no good reason and say that what's described isn't "calculus" per se, because you can't do calculus on discrete objects like a graph. However, you can define the
104.
by dawnofdusk 3y ago
qī and sì sound nothing alike in any dialect of (Mandarin) Chinese I can think of, to Chinese speakers. Shi and shichi literally contain the exact same phoneme.
105.
by dawnofdusk 3y ago
Analog computing is trendy again, though, especially for AI.
106.
by dawnofdusk 3y ago
I just mean that cells in an organism experience much higher noise rates than a CPU, but we still consider them as capable of sophisticated computations. It's hard to peg a number at exactly how much more, but at least for reference ma
107.
by dawnofdusk 3y ago
An interesting question because all of this genetic encoding and expression is probabilistic at its very core (it has to be, otherwise there wouldn't be evolution), whereas it would be very bad if basic operations in a CPU had similar
108.
by dawnofdusk 3y ago
This blog post is one of the best ones I've seen on Nix tbh. Brings a lot of clarity on things people are often confused about ("What is a flake?" "What is a module?"). Hoping it doesn't get drowned in the SEO
109.
by dawnofdusk 3y ago
Why would uncompressed bytes be better? Using a good compression algorithm better approximates the statistical entropy of the code which is at least correlated with e.g., Kolmogorov complexity.
110.
by dawnofdusk 3y ago
I'm surprised no one has ported it to some container-friendly runtime. In any case your threat model for container workflow is already 100x more complicated than some one-server blog with an open SSH port, I would give up on fail2ban i
111.
by dawnofdusk 3y ago
Unix shell utilities as an idea/philosophy are a really good IDE, but in practice a lot of them need major UX overhauls. `find` is awful, for example, if only because it uses single hyphens followed by full words for it's flags (d
112.
by dawnofdusk 3y ago
Not saying that I believe in the conspiracy theory, but can't the disease exist naturally while also being the subject of bioweapon research? The only way to know would be to figure out more precisely what kind of research was being do
113.
by dawnofdusk 3y ago
Type-II super conductors may exhibit "flux pinning". Type-I super conductors do not.
114.
by dawnofdusk 3y ago
Agree. ThePrimeagen had something to say about this on one of his streams, responding to someone who said "The programming language doesn't matter, only the programmer." He said something like "If that were true, let&#x2
115.
by dawnofdusk 3y ago
Personally a lot of the points in this article are pretty decent, but I think the solution is not Rust but something like LFortran ( https://lfortran.org ) which has an interactive REPL, can be AOT compiled, no performance footgun
116.
by dawnofdusk 3y ago
Computer power is expensive and constrained for many scientists...
117.
by dawnofdusk 3y ago
Yeah it's the French word. You can always say just "chaîne" when it's unambiguous. Or you can just use the English word
118.
by dawnofdusk 3y ago
Missing Vivaldi. Native vertical tabs is why I switched from Firefox to Vivaldi.
119.
by dawnofdusk 3y ago
Literally just Angular if you use RxJS, which the author evidently thinks is too hard to understand and so dismisses it.
120.
by dawnofdusk 3y ago
Yeah the "gravitational hum" would not seem to be the same as gravity itself having some inherent randomness. On the flipside, in a very real sense if the cosmological history of our universe is such that we exist in a universe wi

More ›