mechagodzilla

6 ms·

31.
by mechagodzilla 2y ago
The $500 going to the "AI Owner" instead of labor (i.e. the human lawyer) is the productivity gain though, right? And if that was such a productivity gain (i.e. the marginal cost was basically 0 to the AI owner, instead of, say,
32.
by mechagodzilla 2y ago
It's an HP Z8 G4 (dual-socket 18-core, 3 GHz Xeons, 24x32GB of DDR4-2666, and then a crappy GPU, 8TB HDD, 1TB SSD). It can accommodate 3 dual-slot GPUs, but I was mostly interested in playing with frontier models where holding all the
33.
by mechagodzilla 2y ago
Uber's revenue was never coming from other food delivery startups.
34.
by mechagodzilla 2y ago
I have a used workstation I got for $2k (with 768GB of RAM) - using the Q4 model, I can get about 1.5 tokens/sec and use very large contexts. It's pretty awesome to be able to run it at home.
35.
by mechagodzilla 2y ago
Why would I want a drone swarm in VLEO? That seems like a really hard place to effectively use drones from compared to pretty much any alternative.
36.
by mechagodzilla 2y ago
I have a similar setup running at about 1.5 tokens/second, and it's perfectly usable for the sorts of difficult tasks one needs a frontier model like this for - give it a prompt and come back an hour or two later. You interact wit
37.
by mechagodzilla 2y ago
I can run the 671B-Q8 version of R1 with a big context on a used dual-socket Xeon I bought for about $2k with 768GB of RAM. It gets about 1-1.5 tokens/sec, which is fine to give it a prompt and just come back an hour or so later. To ge
38.
by mechagodzilla 2y ago
Being able to see the thinking trace in R1 is so useful, as you can go back and see if it's getting stuck, making a wrong assumption, missing data, etc. To me that makes it materially more useful than the OpenAI reasoning models, which
39.
by mechagodzilla 2y ago
It's currently 2025 . . . 2020 was five years ago.
40.
by mechagodzilla 2y ago
"Packaging" in this context means taking the wafer of compute die (made in Arizona), dicing it up into individual die, mounting it onto a silicon interposer (an even bigger die, no idea where that's made, but probably taiwan)
41.
by mechagodzilla 2y ago
The word 'recession' means something though, and it's neutral on whether or not any particular humans have more income or cheaper goods. If you get a raise at work, it doesn't mean we're not in an economic recession
42.
by mechagodzilla 2y ago
Block RAM in FPGAs is very limited and adding something like a DDR3 controller is a hassle - of the dev boards I have lying around, they have between 48KB and 200KB of block RAM. The actual CPU logic is probably <5% of those chips. I hav
43.
by mechagodzilla 2y ago
Ugh, I just noticed it's even worse - the display is double-buffered, so you actually need 384KB of ram (128KB for system RAM and 2 x 128KB display buffers!).
44.
by mechagodzilla 2y ago
Implementing a CPU, if you're not trying to hyper-optimize it, is reasonably straightforward. This is a very simple design. It would take a little bit more work to add proper video output and mouse input, but those blocks are easy to f
45.
by mechagodzilla 2y ago
The kaypro '84 variants can do 160x100 graphics (each character is a 2x4 block of pixels, and the screen is 80x25 characters).
46.
by mechagodzilla 2y ago
It took me about 20 minutes to make a basic FPGA-friendly implementation of the CPU core in Verilog, but the 256KB of ram is pretty expensive (16-bit color seems excessive for such a simple core!).
47.
by mechagodzilla 2y ago
The PTerm app no longer works on modern MacOS unfortunately.
48.
by mechagodzilla 2y ago
Ooh, I wish there was a Kaypro port!
49.
by mechagodzilla 2y ago
It's got 128KB of on-die SRAM - you could have a Z80 and a 6502, both with a full complement of SRAM!
50.
by mechagodzilla 2y ago
I don't think there is a way to take over Taiwan and preserve TSMC's manufacturing capacity there.
51.
by mechagodzilla 2y ago
That number needs to include car depreciation + any remote 'safety drivers' + the maintenance depot overhead + fuel and insurance + any other costs that scale with the number of cars then.
52.
by mechagodzilla 2y ago
There is absolutely no way they are remotely close to being revenue positive (unless you're asking strictly if they are charging more than the gas they're burning without counting anything else). They have like 700 very expensive
53.
by mechagodzilla 2y ago
That's a terrible blog post that only cites a WSJ opinion piece.
54.
by mechagodzilla 2y ago
I think there probably is an actual niche for space-based solar, depending on how retarget-able it is. Imagine being able to beam 24/7 power to remote mining or military installations, or if you could really steer it, beaming it the re
55.
by mechagodzilla 2y ago
A company giving away money for free could probably beat them (and might lose less money per customer than OpenAI).
56.
by mechagodzilla 2y ago
I bought a used dual-socket xeon workstation with 768GB of RAM for ~$3k and can run the 405B model at ~0.3 tokens/sec.
57.
by mechagodzilla 2y ago
The economic side of Waymo still makes absolutely no sense to me. Uber, with no heavy capital investment, has been pretty much unprofitable for over a decade. The car companies are low margin. The taxi companies are low margin. Alphabet has
58.
by mechagodzilla 2y ago
It was a pretty eye-opening book. I think most people assume individual dams provide far more value than they often do in practice.
59.
by mechagodzilla 2y ago
Wait - they're 'profitable, excluding all of their employee costs'? Does that just mean they're charging more than the cost of their electricity to generate the tokens?
60.
by mechagodzilla 2y ago
Texas has quite a bit of utility-scale commercial batteries now.

More ›