elorant

31 ms·

721.
by elorant 3y ago
By losing performance I meant you don’t need to quantize the model a lot since it fits in RAM. My bad for not clarifying it.
722.
by elorant 3y ago
In my opinion the best hardware to run big models is to go and get a mac studio ultra. You have 192GB of unified RAM which can run pretty much every available model without losing performance. And it would cost you half that price.
723.
by elorant 3y ago
They seem to have six, either 4090s or 3090s judging by the total amount of VRAM. How many more do you think you could get with $15k considering all the other hardware costs? I doubt you could make it more efficient at this price point.
724.
by elorant 3y ago
You can undervolt gpus without loosing that much performance.
725.
Scaling the Instagram Explore recommendations system(engineering.fb.com)
1 points by elorant 3y ago|0 comments
726.
by elorant 3y ago
I self host an LLM (Vicuna 13b) for two reasons. One is cost, and the second is privacy. I don’t want OpenAI or any other provider knowing what I'm working on because they could replicate it. I'm not saying that they would conside
727.
Hawaii's emergency siren warning system was silent during Maui wildfires(cnn.com)
2 points by elorant 3y ago|0 comments
728.
Sam Bankman-Fried is going to jail(arstechnica.com)
161 points by elorant 3y ago|173 comments
729.
Study shows dementia more common in older adults with vision issues(michiganmedicine.org)
142 points by elorant 3y ago|77 comments
730.
Texas could get a bullet train between Houston and Dallas(popsci.com)
39 points by elorant 3y ago|94 comments
731.
Oracle, SUSE, and CIQ Go After Red Hat with Open Enterprise Linux Association(zdnet.com)
6 points by elorant 3y ago|0 comments
732.
Fedora Linux on M-powered Macs will be here shortly(zdnet.com)
54 points by elorant 3y ago|9 comments
733.
Will AI wipe out architects?(theguardian.com)
2 points by elorant 3y ago|2 comments
734.
July was Earth's hottest month on record(euronews.com)
2 points by elorant 3y ago|0 comments
735.
Remains found in China may belong to third human lineage(phys.org)
3 points by elorant 3y ago|0 comments
736.
Electric cars became a battleground in the culture wars(theguardian.com)
3 points by elorant 3y ago|1 comments
737.
Of Course We’re Living in a Simulation(wired.com)
5 points by elorant 3y ago|0 comments
738.
AI brain implant surgery helped a man regain feeling in his hand(popsci.com)
1 points by elorant 3y ago|0 comments
739.
First U.S. nuclear reactor built from scratch in decades(nbcnews.com)
30 points by elorant 3y ago|2 comments
740.
The Windows desktop is dying(computerworld.com)
90 points by elorant 3y ago|154 comments
741.
Going Viral(growbyginkgo.com)
1 points by elorant 3y ago|0 comments
742.
Researchers find deliberate backdoor in police radio encryption algorithm(wired.com)
1 points by elorant 3y ago|0 comments
743.
Amsterdam bans cruise ships(bbc.com)
150 points by elorant 3y ago|161 comments
744.
by elorant 3y ago
Probably a collection of all available large language models. Haven't managed to access the site but by the name and some comments I can deduce that much.
745.
Coinbase CEO to Meet US House Democrats on Wednesday(reuters.com)
2 points by elorant 3y ago|0 comments
746.
by elorant 3y ago
You could pay to customize it and/or retrain it for your use case. Or you pay a subscription and every few months you receive updated weights.
747.
Pixel Fold review: The first foldable that feels like a tablet(arstechnica.com)
2 points by elorant 3y ago|0 comments
748.
by elorant 3y ago
Large corps will never upload their documents on the API. ChatGPT needs a standalone black box if it's gonna penetrate the corporate world.
749.
by elorant 3y ago
On the same context, it's quite good for neologisms which could be great if you're looking for a new company name, or a product name, or whatever. You give it two words and ask it to make combinations and then it goes ballistic pr
750.
The ground is deforming, and buildings aren’t ready(news.northwestern.edu)
3 points by elorant 3y ago|0 comments

More ›