ml_thoughts

5 ms·

1.
by ml_thoughts 2y ago
This seems closely related to the "Mixtral" approach of a mixture-of-experts transformer [1]... I'm not claiming the approach is not original, it just helped me understand what was going on. Consider a case of two "exper
2.
by ml_thoughts 6y ago
This code seems to somewhat re-create effect, except noise is symmetric at both sides (also true of the xkcd-style plot in this article, actually). Plot: https://imgur.com/a/dGZyylf It seems a crucial piece of context
3.
by ml_thoughts 6y ago
Link to biorxiv version: https://www.biorxiv.org/content/10.1101/2020.02.03.931923v1 Summary because the title overstates significance a bit (of a cool paper): Most sequencing today is done using Illumina machines
4.
by ml_thoughts 6y ago
The problem of experienced professionals vs grad students seems to be a real problem for science. Academia could really do with a build-out of experienced research scientists able to make careers out of consistently building experience and
5.
by ml_thoughts 6y ago
A problem that I was surprised to not be solved well is the study of paths (not represented as graphs). It seems that for example trying to cluster trajectories over time through real coordinates has a bit of prior work (there’s a bit of an
6.
by ml_thoughts 7y ago
Went up this morning on arXiv: https://arxiv.org/abs/1911.04523
7.
by ml_thoughts 7y ago
The posted article isn't particularly fascinating, but for a bit of fun, there's an OpenAI project where they demonstrate that due to the non-linear rounding of Float32 values you can actually train "non-linear" linear n
8.
by ml_thoughts 7y ago
The DNA/RNA that encodes the proteins can itself be structured in a way that might be disrupted by synonymous amino acid changes. In particular, recent work in the field has shown that changing codons near the start of the gene can dis
9.
by ml_thoughts 8y ago
The Decameron has a contemporaneous account of the plague in Florence that has always stuck with me in its first section, "The Plague of Florence" (you can see here, http://faculty.sgc.edu/rkelley/The%20Decame
10.
by ml_thoughts 8y ago
Worth noting that there has been a fair bit of good research in causal machine learning in the last year or so, for example "Implicit Causal Models for Genome-wide Association Studies" ( https://arxiv.org/pdf/1
11.
by ml_thoughts 9y ago
Another more modern and well-documented example of this would seem to occur in a 2015 write-up of the "Right Whale" competition in Kaggle: http://felixlaumon.github.io/2015/01/08/kaggle-right-whale.h
12.
by ml_thoughts 9y ago
I think an aspect of deep learning that is often overlooked is that it is still not clear how much of current algorithm performance is defined by local "obsession to detail" vs global "understanding" of the subject matte