atylerrice

3 ms·

1.
by atylerrice 4y ago
You can also use int8 quantization which comes for free with huggingface and isn’t a huge cost to accuracy. Which cuts the memory usage almost in half again. (almost in half because some layers might stay 32 bit if they make a tiny part of
2.
by atylerrice 4y ago
This is incorrect. Thought would be interesting. Pruning usually removes some parameters from the model (setting certain ones to 0 for instance). The smaller models all have less layers and therefore weren’t pruned but were smaller to begin
3.
by atylerrice 4y ago
Well the batch size also helps with making training more stable. So a larger batch size computes the gradient across more examples so it ends up being more stable than only using a batch size of day one. A batch size of one is only fixing t
4.
by atylerrice 4y ago
I don’t usually comment, but aws is actually rather expensive and i’ve hit this annoying quota problem as well. Been back and forth and still hasn’t been raised. I can also recommend coreweave banana.dev and pipeline.ai as great alternative
5.
Neural Network inference on commodity CPUs using sparsity(neuralmagic.com)
2 points by atylerrice 4y ago|3 comments
6.
Ask HN: How do you stay focused with competing priorities?
25 points by atylerrice 5y ago|8 comments
7.
by atylerrice 6y ago
I’ve seen this a lot. I think sometimes in my experience it comes down to what is work? As a developer I would classify a lot of the meetings I’ve had at past companies where it takes up 40% of my time as not really working. Sometimes these
8.
by atylerrice 6y ago
I totally agree but I’m excited for some recent initiatives to fix this. https://www.researchallofus.org/ This research project is open even to at home scientists although I think some of the genomic data may reasonably not
9.
by atylerrice 6y ago
I built Hatchedwith.com mostly because I wanted to mess around with language models. I can’t seem to find any customers even though I got two from a fake landing page but realistically it’s not the product I advertised in the beginning I’m
10.
Show HN: A mailing list that sends a short story to your inbox every week(shortdailystory.com)
2 points by atylerrice 10y ago|0 comments
11.
Show HN: Receive a short story in your inbox everyday – Short Daily Story(shortdailystory.com)
4 points by atylerrice 10y ago|0 comments