bevekspldnw

9 ms·

91.
by bevekspldnw 3y ago
Gonna say you’re way off there. Once you decompress common crawl and index it for FTS and put it on fast storage you’re in for some serious pain, and that’s before you even put it in your ML pipeline. Even refined web runs about 2TB once lo
92.
by bevekspldnw 3y ago
I mean, you’re not wrong. I’ve been building some unrelated web search tech and have considered just indexing all the sites I can about and making my own “non shit” search engine. Which really isn’t too hard if you want to do say, 10-50 sit
93.
by bevekspldnw 3y ago
Not Llama, they’ve been really clear about that. Especially with DMA cross-joining provisions and various privacy requirements it’s really hard for them, same for Google. However, Microsoft has been flying under the radar. If they gave all
94.
by bevekspldnw 3y ago
Oh really? Who else should I be looking at? That person is a hero, super bummed!
95.
by bevekspldnw 3y ago
Yeah and the instruct tunes provided by Mistral on other models are pretty great.
96.
by bevekspldnw 3y ago
I really want to see some benchmarks with performance weighted by energy use. I think Mistral 7B performance to watt would be the leader by a huge margin. On many tasks I get equal performance on zero shot classification tasks on Mistral th
97.
by bevekspldnw 3y ago
Wish it had GPT-4, that’s the one to beat still.
98.
by bevekspldnw 3y ago
There is a user called The Bloke on hugging face- they release pre quantized models pretty soon after the full size drop. Just watch their page and pray you can fit the 4 bit in your GPU. I’m sure they are already working on it.
99.
by bevekspldnw 3y ago
The end state of training on web text has always been an ouroboros - primarily because of adtech incentives to produce low quality content at scale to capture micro pennies. The irony of the whole thing is brutal.
100.
by bevekspldnw 3y ago
I dunno, he burned a lot of cash on metaverse and wasn’t focused on FB. All the top talent was moved over to Metaverse and FB was treated as career killer. My impression is ads work is once again a good career play. People chase promo.
101.
by bevekspldnw 3y ago
Distributing anything as python pickles seems utterly batshit to me.
102.
by bevekspldnw 3y ago
Yup, I just wish Samsung made an 8TB NVME!
103.
by bevekspldnw 3y ago
Scaling databases both oddly frustrating and also rewarding. Getting that first query that executes at 10x of the old one feels great. The week of agony that makes it possible…less so.
104.
by bevekspldnw 3y ago
Pretty fascinating they mention applications for ad serving but not Metaverse. I feel like Zuck figured out he’s just running an ads network, the world is a long way anway from some VR fever dream, and to focus on milking each DAU for as ma
105.
by bevekspldnw 3y ago
Mmm, it’s not that straight forward: indexes can vastly slow down large scale ingest, so it’s really about when to index as well. I work with a lot of multi billion row datasets and a lot of my recent focus has been on developing strategi
106.
by bevekspldnw 3y ago
The first is the mechanism for the second.
107.
by bevekspldnw 3y ago
Yes, but the entire MFi program is just a consumer tax paid to Apple. It’s an extortion racket.
108.
by bevekspldnw 3y ago
The numbers for Firefox just no longer justify any form of real testing or investment. There’s a subtle, but real, event horizon when a platform is no longer big enough to have any external buy in and then the collapse accelerates. The old
109.
by bevekspldnw 3y ago
Typical Apple hiding behind the walled garden to avoid actual competition via users not having any path to switching platforms. The Apple value prop used to be “it all works together”, now it’s “half the shit you spent thousands on won’t wo
110.
by bevekspldnw 3y ago
I’m gonna guess operator error on this one.
111.
by bevekspldnw 3y ago
Yeah I did that but it keeps nagging to verify the email. I don’t know if it will give up at some point. It’s absurdly user hostile. Not to mention they are clearly forcing email so they can key it against the MUID ads cookie.
112.
by bevekspldnw 3y ago
Nope, they just changed it, the old bypasses don’t work. The sole work around is to put in a fake email and then suffer the prompts.
113.
by bevekspldnw 3y ago
And I’m confident I don’t want to use an operating system that forces me to disclose my email address to use the damn computer. I just bought a Microsoft branded laptop and to my horror it wouldn’t let me even create a local account without
114.
by bevekspldnw 3y ago
We just need infinite monkeys producing infinite training data and reliable fusion power for infinite data centers. Easy.
115.
by bevekspldnw 3y ago
I feel like this is the sort of thing Alphabet was supposed to do, but instead Google’s ad machine steamrolled any actually new ideas and even now, after having OpenAI start to take a bite of their lunch, Google’s ad business is calling all
116.
by bevekspldnw 3y ago
“We are running a cloud platform that tracks tens of thousands of people and vehicles simultaneously” …that’s not something to brag about.
117.
by bevekspldnw 3y ago
No regrets quitting my non-tenure faculty position at a top 3 program.
118.
by bevekspldnw 3y ago
I’ve really starting paying attention recently to how many people in positions of power are willing to literally kill thousands of people to gain material wealth they have no practical use for. Boeing being the poster child for this trend,
119.
by bevekspldnw 3y ago
It’s amply clear from reporting that the IDF has no formal RoE on the ground - low level commanders have full autonomy to kill whomever, whenever, with zero oversight. The “AI” exists to retcon the justification for any particular genocidal
120.
by bevekspldnw 3y ago
Regular reminder his voters are the minority and he’s never won a popular vote.

More ›