lowbloodsugar

6 ms·

31.
by lowbloodsugar 1mo ago
3.8-flash-next fits on a single 6000 at Q4 if you offload the PLE. Crazy fast and still effective.
32.
by lowbloodsugar 1mo ago
That’s … Googles entire reason for making these “you don’t pay with money” tools. Did you not understand that?
33.
by lowbloodsugar 1mo ago
Would the 40 Mac’s work with pipelining though?
34.
by lowbloodsugar 1mo ago
You would have the same issue with a GPU. I have 8 slots on my CPU but it cant handle 2.8TB of ram. I cant even buy 2TB for it because even though the mobo is rated for it, nobody ever made those chips (someone will sell me 8x256gb 8Rx4 for
35.
by lowbloodsugar 1mo ago
Libertarianism is entirely self-serving. I am rich and have property, so my ideal government is one whose only job is to create property registries and allow their enforcement with violence. Ideally, the poor people are taxed (not me of cou
36.
by lowbloodsugar 1mo ago
quibble: unsafe is stable. you can't do this in safe rust, but you can do it in unsafe rust. just isolate all the unsafe code in a single type, ideally a tiny crate.
37.
by lowbloodsugar 1mo ago
Take a look at triomphe's ArcUnion and extrapolate from there. Basically make a crate for just your 64bit union type, do it unsafe there, test with miri, and now you have a safe 64bit type you can use with match. You're happy digg
38.
by lowbloodsugar 1mo ago
I've got an M1 Max 64GB too. It's just not an LLM-class workstation. Give it a year and buy an M7 and you'll be laughing. Right now is a really bad time to invest in anything - using the cloud is the cheapest option, especial
39.
by lowbloodsugar 1mo ago
Sure, but if you're going to publish it, at least run it through an edit prompt and tell it to remove clickbait "Its not X, its Y" rubbish. Like literally calling examples clickbait in the prompt has given me better results.
40.
by lowbloodsugar 1mo ago
If it digs itself into a hole, try low or medium. In the rust coding benchmarks (on my machine) it did better on low and medium because xhigh never finished.
41.
by lowbloodsugar 1mo ago
The peasants have lawyers now?! No! Must be banned!
42.
by lowbloodsugar 1mo ago
Spotify? The company pushing AI “music” into people’s feeds to save money on royalties? That Spotify?
43.
by lowbloodsugar 1mo ago
Sure! IBM and Spotify, two companies united in being famous for not being software consulting businesses and definitely not ever developing software development tools.
44.
by lowbloodsugar 1mo ago
Bob the Builder? Right age bracket I guess.
45.
by lowbloodsugar 1mo ago
FTA: Anthropic: 6:23 am PT. OpenAI: 7:43 am PT. Watched it happen. Doesn't look like traffic moving off OpenAI took out the others. Looked like the opposite. The Anthropic thread was initially chock full of marketing accounts claiming
46.
by lowbloodsugar 1mo ago
A “control plane” is the system that would tell the hosts to stop the containers. If that is hacked then you don’t get to “just stop” anything. A scenario would be one where it gets control of the control plane and changes all the ssh keys,
47.
by lowbloodsugar 1mo ago
Ok, I need to try that. I'm getting 45tok/s with vLLM on my 6000. >600tok/s concurrent, but 45tok/s single request.
48.
by lowbloodsugar 1mo ago
What I find fascinating is that this thread was chock full of people saying “Well this is the last straw: I’ve just signed up for Codex.” And now every single one of them is gone. They felt like marketing shitposts when I read them and thei
49.
by lowbloodsugar 2mo ago
We're talking about the military. Many years ago I heard a presentation by an IT guy in the marines. He stated that senior officers would regularly give him instructions that would violate some policy or other - such as giving their se
50.
by lowbloodsugar 2mo ago
>They are usually on a separate Network. Then someone plugs in a cable because boss wants something "over there" and there's already a network that runs "over there". Or optimizes to a smart switch with vlans, an
51.
by lowbloodsugar 2mo ago
I use AI every day and have unlimited budget. I will certainly not trust it to write safe, system level code for our systems. You absolutely do need to be playing blindfold chess and you can’t do that if the other actor doesn’t tell you the
52.
by lowbloodsugar 2mo ago
>I realized I’d been sitting on the one thing most of those threads were missing: a machine that can actually run it properly, and time to measure it. This was written by AI I take it. The one thing, huh? All those idiots running it on t
53.
by lowbloodsugar 2mo ago
Oh come now. Just pay your corruption tax to a nice middleman that helped create this in the first place. “Nobody thought of what this would do to small businesses”? Oh sweet summer child. Someone did the math.
54.
by lowbloodsugar 2mo ago
I was an H1B and this is a fucking lie.
55.
by lowbloodsugar 2mo ago
>A PC with similar capabilities is going to sound like a jet taking off. Not at all. Airflow with big fans is quiet. What I do hear is coil-whine. In fact my PC is quieter than my Macbook when both are running top speed. But one has 4000
56.
by lowbloodsugar 2mo ago
> Elgato signs the firmware updates with Ed25519 over a SHA-512 hash of the firmware payload, and rejects firmware that doesn’t validate. Oh very good! > This means that a single HTTP POST of ATSE=0200ED94,0E001009 turns the signature
57.
by lowbloodsugar 2mo ago
Ask why does China have cheap energy. Indeed, why was China able to save Trumps ass by halving its oil imports and preventing a catastrophic meltdown of oil-driven economies?
58.
by lowbloodsugar 2mo ago
Japan did start selling off US treasuries because the yen is fucked. They stopped when the US agreed to buy yen and sell euros. If China starts selling treasuries, US is fucked. But it’s in China’s interest to have this incompetent in pow
59.
by lowbloodsugar 2mo ago
The US is desperately selling currency so it can buy the Yen so that Japan doesn’t ditch its US treasuries.
60.
by lowbloodsugar 2mo ago
The Democrats are part of the system.

More ›