5 ms·
With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy. (Sorry, I had to, with all the AI flood, I really was a
by msk-lywenn 1y ago
With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy.
(Sorry, I had to, with all the AI flood, I really was about to skip this info after the first 3 characters)
- ghurtado 1y agoDon't be sorry, that was pretty good
- freddier 1y agoThey very rare great HN joke.
- maybelsyrup 1y agoHow true this is
- deafpolygon 1y agothat's too good, haha
- positisop 1y agoGlad you wrote it, the title took me down the same path for a few seconds :-D
- belter 1y agoResearchers discovered the black hole has been consuming AI VC money, at the rate of $50M per day, and so finally explaining why it is gotten so big.
- gibolt 1y agoThat sounds low...
- ozim 1y agoI had a bit of a pause trying to figure out if someone named a model „black hole” from that title. Hype is strong.
- M4R5H4LL 1y agothanks for brightening the day :)
- AmericanOP 1y agoBut can you make it talk dirty to me
- dataflow 1y agoSo you're saying it might fit on the S26?
- p1esk 1y agoWith good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.
- deleted 1y ago[deleted]