burke

8 ms·

31.
by burke 3y ago
Seriously. This was the most abusive reading experience I’ve come across in a while. I also only got to read a couple of paragraphs before endless ads.
32.
by burke 3y ago
Napkin math: 7x(4/8)x8 is 28GB, and q4 uses a little more than just 4 bits per param, and there’s extra overhead for context, and the FFN to select experts is probably more on top of that. It would probably fit in 32GB at 4-bit but pro
33.
by burke 3y ago
I mean, the difference between these two is a mathematical technicality. For all practical purposes it’s the same thing.
34.
by burke 3y ago
Good point, better not try.
35.
by burke 3y ago
I’m not sure what the globe is written but I’m pretty sure the comment is referring to the shopify core platform scaling to that many dollars of throughput, and while, yes, certainly there are peripheral bits in a variety of languages, the
36.
by burke 3y ago
https://www.reuters.com/business/sustainable-business/stripe... https://www.shopify.com/ca/blog/carbon-removal
37.
by burke 3y ago
Rapamycin likely does this.
38.
by burke 3y ago
Legality is a concept defined by the governments doing the things. It's funny to see people react to something they perceive as immoral and just claim it's illegal. I'm no legal expert but I'm reasonably confident one or
39.
by burke 3y ago
This is really not that onerous. Anyone commercial already has to go in for 100hr inspections all the damn time. The STC is unlikely to cost much relative to that, nor to add much additional hassle. Anyone private can deal with it, they own
40.
by burke 3y ago
Fluoride in drinking water is a kind of truly marginal level of harm that’s perfectly designed to trigger paranoid libertarians. A tiny amount of fluoride is helpful for bones and especially teeth. Fluoridated toothpaste covers this need pe
41.
by burke 3y ago
If there was some other major thing that came online in 2018, I think it would be easy to rationalize this chart as confirmatory evidence of that too, though I mostly agree.
42.
by burke 3y ago
You can go pretty deep once you get context free grammars. For example, I'm using torch-grammar (but outlines should be able to do the same thing once CFG support is merged) to not just restrict the format of a generation to a DSL&#x27
43.
by burke 3y ago
torch-grammar generates a mask per PDA stack... we don't try to compute all the possible stacks. I'm sure there's something smarter that could be done here and you've probably figured it out (though IIRC regular language
44.
by burke 3y ago
Yes! This is closer to the approach I took in my port of llama.cpp's grammar support to PyTorch: https://github.com/Shopify/torch-grammar/blob/main/torch_gra... ... it generates a tensor mapping eac
45.
by burke 3y ago
Summary: some combination of: - they’re smaller chickens and it’s not as much cheaper as it seems - it’s a loss leader.
46.
by burke 3y ago
Sure, here it is. It's extremely rough but it works as a starting point: https://gist.github.com/burke/6d035758f7492612e2ad86bb7de2d5...
47.
by burke 3y ago
I implemented this for PyTorch too at https://github.com/Shopify/torch-grammar . I have a hacked version of text-generation-inference that uses it—happy to share that if it’s useful to anyone.
48.
by burke 3y ago
This is a claim by an organization on ownership of a phrase used by humans in common speech. That doesn’t mean it’s what people mean when they say it.
49.
by burke 3y ago
The source is open. “Open Source” does not mean the FLOSS-flavour of Open in conventional speech. If you want to fight that battle, sure, it’s not unreasonable, but realize that you’re pushing a sub-consensus view.
50.
by burke 3y ago
Steel pans—really any pans that just look like metal on the inside—are not made with "forever chemical" coatings.
51.
by burke 3y ago
I mean the average lifespan in the year 1000 was about 31, so we’re doing at least a few things right.
52.
by burke 3y ago
Terminals fortunately make it quite easy to map the basic 8 colors to whatever you like. There are very few people who can’t select 8 mutually distinguishable colours. They could even choose shades of grey! This is an argument against using
53.
by burke 3y ago
This was partially true at points (though we've always done quite a bit better than government), but categorically stopped being true with: https://news.shopify.com/rewriting-the-story-of-compensation -- now it's
54.
by burke 3y ago
Yeah: it's almost more true to say that `a === b` just means whatever we've decided `case b when a` should check. `===` is almost never used directly.
55.
by burke 3y ago
If all donated blood was screened for trace microplastics, I think we’d have an immediate and total donor blood shortage.
56.
by burke 4y ago
This is the thing that's so tricky about... well, I guess the way our world models in general work. Is drinking bad for you? Yup. Is smoking bad for you? Yup. Is moderate social drinking bad for you? Likely, but definitely less bad for
57.
by burke 4y ago
We’ve been using Go since 2013. We recently started using Rust, but it’s mainly eating away at Go’s usage rather than Ruby’s. Ruby continues to be our first-choice language for most problems.
58.
by burke 4y ago
> MWI is equivalent to a simpler interpretation that doesn’t require split universes. That simpler interpretation is also equivalent to a simpler implementation that doesn’t require apparently-arbitrary resolutions of quantum probabiliti
59.
by burke 4y ago
No, I just think for all ruby is bought into these guard clauses, it's sad that we generally reject the feature that allows putting either the condition or the consequence first, depending on which reads better.
60.
by burke 4y ago
Indeed, but the return value of a guard clause shouldn't be important!

More ›