nstrayer

4 ms·

1.
by nstrayer 7y ago
I did use spot instances for most of the clusters and a few of the processing jobs! I got out of the habit of using them earlier due to loosing them but now that they have the 'pay up to the on-demand price' option they're gr
2.
by nstrayer 7y ago
As a followup to this. We have now successfully run complex statistical models across all 2.5 million snps on a single AWS instance in less than 3 hours just by writing R code using the package I describe at the end of the article.
3.
by nstrayer 7y ago
Pretty much. I am sure if I truly understood the inner workings of spark I would have been able to get it to work. I didn't go into it too much in the article but I did tweak the executor memory a lot. Going as far as transcribing the
4.
by nstrayer 7y ago
Of course! Glad you posted it. I didn't realize that many people would find it interesting.
5.
by nstrayer 7y ago
It's a plain chip, just one specially made for our institution by illumina. As to why they would deliver it in tsvs, that I can't answer.
6.
by nstrayer 7y ago
Hi! Author of the post here. I can attempt to answer any questions if need be although it looks like others have done a great job doing that already!
7.
T-SNE explained in plain JavaScript(beta.observablehq.com)
2 points by nstrayer 9y ago|0 comments
8.
by nstrayer 9y ago
I would tend to disagree with this assessment. Nathan has a Ph.D. in statistics and as someone who is a Ph.D. candidate in the same field, I know for certain he has done a lot of thinking about this. - For the gaps example, I think it'
9.
by nstrayer 9y ago
Oh no! That's my bad. I always default to using the spread operators because it's so nice and I live in nice new browsers.