ein0p

43 ms·

721.
by ein0p 2y ago
The weight releases for LLMs are equivalent to binary releases for software. The “source code” here is the dataset, which is not disclosed.
722.
by ein0p 2y ago
They’re “failing” to investigate Epstein’s client list, too. The whole thing basically needs to be disbanded and investigated itself, then rebuilt from scratch. This is banana republic grade stuff.
723.
by ein0p 2y ago
These are some interesting mental gymnastics. Zuckerberg literally publicly admitted the other day that he was forced by the government to censor things without a legal basis. Musk disclosed a whole trove of emails about the same at Twitter
724.
by ein0p 2y ago
I’m not sure why anyone would want to handle field repairs where a rocket can blow up your entire operation at any time. Or maybe have some other type of repair in mind. In for a penny, in for a pound, bros.
725.
by ein0p 2y ago
There actually is - see the various revolutions over the past few hundred years. But, as always, there’s a “but”: things would need to get much worse for that to be possible, and they would deteriorate by another order of magnitude after it
726.
by ein0p 2y ago
The walrus operator doesn’t seem like such a big deal now given these developments, and no doubt future developments of the same sort. The permanently offended aren’t going to just go until everything is in ruins and all the main contributo
727.
by ein0p 2y ago
He should have stayed on as BDFL. Now in the power vacuum a bunch of “activists” and political enthusiasts will take over and ruin the whole thing for everyone, or at least significantly slow down the progress
728.
by ein0p 2y ago
IIRC the airlines did improve filtering of air in the cabin, but I think this is basically moot - you’re stuck in a hermetic, pressurized can with hundreds of other people and some percentage of them is exhaling viral droplets into the air
729.
by ein0p 2y ago
Not parenting is hazardous to our survival as a species, or at least ethnic groups. He who procreates shall inherit the earth.
730.
by ein0p 2y ago
I had terrible grass and pollen allergies until I started mowing my own lawn and gardening without gloves. Exposure therapy is a thing. It works at least for some people.
731.
by ein0p 2y ago
Doubtful that he’s “frequenting” there given how he left the country. When the FSB (Russian FBI) demanded he comply with the laws and provide the decryption keys he had his lawyers send a prank letter to the head of the FSB with two physica
732.
by ein0p 2y ago
They probably already have that ability. And not only they.
733.
by ein0p 2y ago
I have discovered a trick for meetings. Aside from one or two half hour meetings that I consider useful I mostly just say “maybe” to the rest and then hardly ever go to them. That way I have the requisite “brick wall” calendar, so I appear
734.
by ein0p 2y ago
No, that is always the case. Attention is only about one third the ops and qk is a fraction of that. Outside of truly massive sequence lengths it doesn’t matter a whole lot, even though it’s nominally quadratic. It’s trivial to run the numb
735.
by ein0p 2y ago
The coarse estimate of compute in transformers is about as many MACs as there are weights, or twice as many flops (because multiplication and addition are counted as separate operations). So for llama 70b that’s about 70b MACs per token, wh
736.
by ein0p 2y ago
+1. For inference especially compute is abundant and basically free in terms of energy. Almost all of the energy is spent on memory movement. The logical solution is to not move unaggregated data.
737.
by ein0p 2y ago
8b models won’t even need a server a year from now. Basically the only reason to go to the server a year or two from now will be to do what edge devices can’t do: general purpose chat, long context (multimodal especially), data augmented ge
738.
by ein0p 2y ago
When it comes to truly novel things, 20% of even modest success is a very high number. I worked in research heavy places (industry labs) over the last decade and if 90% of things you try do not fail, your work is not ambitious enough. That
739.
by ein0p 2y ago
Refute and “check” this one: https://x.com/wikileaks/status/1828151621651447908 TL;DR: Five Eyes is pissed traffic is encrypted and they don’t have a back door.
740.
by ein0p 2y ago
[flagged]
741.
by ein0p 2y ago
You’re making it sound easier and more certain than it really is. “Engaging with local government” is very often ineffective. Case in point: our municipal government bought a hotel right across the road from a high school and converted it f
742.
by ein0p 2y ago
You’re not automating the “art” with llms. You’re automating stretching the canvas and squeezing out the paint. LLMs by design can’t create anything fundamentally new. Which is the “art” part of the whole exercise.
743.
by ein0p 2y ago
You look at both sides and try to get some nuggets of truth out of that mountain of bullshit by checking what doesn’t line up. Thing is, though, if you only look at the mainstream media, you can’t even figure out what’s bullshit - the confl
744.
by ein0p 2y ago
The main problem with Telegram is it’s not subject to Western surveillance and censorship. Best I can tell, it’s also not subject to Eastern surveillance and censorship which is why it was (unsuccessfully) banned in Russia in 2018. As of ri
745.
by ein0p 2y ago
It has everything to do with both Russia and Five Eyes. Don’t be naive.
746.
by ein0p 2y ago
"You'll wear yourselves out swallowing dust, running around the courts to unblock the assets." (c) Vladimir Putin when persuading Russian oligarchs to repatriate their wealth. Turns out he was right.
747.
by ein0p 2y ago
Precisely. LLM assistance is how I felt in the 90s about programming in Delphi and C++ Builder. It felt like cheating, but in a good way, I was getting to solving my problem in no time at all. Except back then it was mostly about the UI, an
748.
by ein0p 2y ago
Really? It automates the extremely boring and low skill part of your job and you "feel sick"? I feel pretty great about getting to focus on the actual problem rather than on boilerplate.
749.
by ein0p 2y ago
Because the whole thing sounds like they’re doing something new, but they’re just catching up to something Apple has done back when they switched to aarch64.
750.
by ein0p 2y ago
99% of eligible buyers don’t care one way or another. As big as it may seem to you, the US neoliberal bubble is not really that large. That’s why Tesla sold 1.81M cars last year. It is a formidable number no matter how you look at it.

More ›