ein0p

26 ms·

391.
by ein0p 2y ago
It doesn't. Inference is still expensive, and demand for it is high, as evidenced by Anthropic's frequent "we're out of quota" messages and Deepseek's crap-out under load last night. On the training side right
392.
by ein0p 2y ago
Yes, English text in pretraining will necessarily have similar distribution. But when it comes to alignment, distributions will be different, since that data is typically not shared. The metapoint is - it is not realistic to expect complete
393.
by ein0p 2y ago
US models are censored AF as well, just for a different set of taboos.
394.
by ein0p 2y ago
It's complicated. On the one hand Nvidia is supply constrained, so anything that makes AI better and more efficient (and therefore more usable by the masses) is bullish for it. On the other, a significant chunk of research lower tier l
395.
by ein0p 2y ago
I was confused, actually, not you. The output was: cat /sys/dev/block/8:176/queue/scheduler [mq-deadline] none However, this output does not mean what I thought it did - it means that mq-deadline is in use. If
396.
by ein0p 2y ago
16 years old and there's still video tearing in the browsers. I try it with every Ubuntu LTS release, and then switch back to X in a few days. It solves problems I just don't have.
397.
by ein0p 2y ago
The main problem isn't actually context length most of the time. 128K is plenty for a lot of practical tasks. It's the generation length, both within turns and especially across turns. And nobody knows how to increase that signifi
398.
by ein0p 2y ago
OK, it's 2025. You have received $1M in cash. The US stock market is ludicrously overvalued across the board. What's your move?
399.
by ein0p 2y ago
US dollar is also constantly and arbitrarily diluted by the Federal Reserve, to the tune of $2-3T a year. If it was a stock, you'd run away in horror.
400.
by ein0p 2y ago
I mean that it's already "none" on the machine where I encountered this bug. "Upd" was merely to signal that I've made an edit to my post.
401.
by ein0p 2y ago
You forgot to say "so far". One of my managers was also flying high circa 2000 - multiple lakefront properties, Porsches you name it, the guy was living the life. In 2002 he was bankrupt - didn't sell his tech stocks in time,
402.
by ein0p 2y ago
What do you own if you hold a money market cash position? The exact same thing as Bitcoin - faith of other people that currency is worth something. Look, I'm not a crypto bro or anything, but Vanguard talking about speculation is the a
403.
by ein0p 2y ago
Thanks a lot for elaborating. I'm traveling at the moment, but I'm going to try reproducing this issue once I'm back in town. IIRC I did do partitioning myself, using GPT partition table and default partition settings in fdis
404.
by ein0p 2y ago
MBS does need to pay lip service to the US, but he's better off investing in Eurasia IMO, and/or in SA itself. US assets are incredibly overpriced right now. I'm sure he understands this, so lip service will be paid, dances w
405.
by ein0p 2y ago
I bet the Chinese can build 5 nuclear reactors for a fraction of that price, too. Deepseek says China builds them at $2.5-3.5B per 1200MW reactor.
406.
by ein0p 2y ago
Regarding your comment - seems unlikely that it "affects Ubuntu less". I don't see why that would be the case - it's not like Ubuntu runs a heavily customized kernel or anything. And thanks for taking a look - ZFS is jus
407.
by ein0p 2y ago
Because it's roughly on par with OpenAI's o1 which is not something the gigantic and extremely lavishly resourced GenAI org at Meta has managed to even come close to so far. And DeepSeek's non-CoT model, DeepSeek V3 makes LLa
408.
by ein0p 2y ago
He had to worry about getting re-elected last time.
409.
by ein0p 2y ago
What's the human baseline?
410.
by ein0p 2y ago
Dude panicked so bad after the DeepSeek R1 release he came back to X to pat himself on the back.
411.
by ein0p 2y ago
I'm not sure it is gone. I think, if anything, it's gotten worse, due to widespread surveillance.
412.
by ein0p 2y ago
ZFS on Linux unfortunately has a long standing bug which makes it unusable under load: https://github.com/openzfs/zfs/issues/9130 . 5.5 years old, nobody knows the root cause. Symptoms: under load (such as wha
413.
by ein0p 2y ago
You don't get to order such things "before inauguration".
414.
by ein0p 2y ago
We'll see about that, won't we? Trump has just declassified JFK, RFK and MLK files. Was MLK an "extremely violent criminal"?
415.
by ein0p 2y ago
ChatGPT says "spinach is rich in iron" by the way. Even more interestingly, it knows that "rich in iron" is bullshit, and explains when challenged (both the oxalates and the typo in research). This actually mirrors a pro
416.
by ein0p 2y ago
Ironically, the only thing they really need for their own AI accelerators (eg Huawei Ascend 910 and its derivatives) to take off are our chip bans, especially if they last years. Right now NVIDIA stymies those efforts by being the "def
417.
by ein0p 2y ago
I wouldn't be so sure. Sam Altman has managed to post _a lot_ of interesting tweets about Donald Trump over the years, starting as far back as 2016, and they're all now getting reposted, sure to get Trump's attention. That&#x
418.
by ein0p 2y ago
Yes. If you stop producing steel (which we kinda did), and just buy it from China instead, you haven't "eliminated emissions". You've merely moved them to a country which is currently not subject to the environmental lim
419.
by ein0p 2y ago
We're talking about _Japan_. They, presumably, already "pay people for their labor" and collect enough taxes for infrastructure.
420.
by ein0p 2y ago
My models are both 4 bit. But yeah, that could be - small models are much worse at tolerating quantization. That's why people use LoRA to recover the accuracy somewhat even if they don't need domain adaptation.

More ›