4 ms·
There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing. Still, t
by ivraatiems 7mo ago
There's some irony in the fact that this website reads as extremely NOT AI-generated, very human in the way it's designed and the tone of its writing.
Still, this is a great idea, and one I hope takes off. I think there's a good argument that the future of AI is in locally-trained models for everyone, rather than relying on a big company's own model.
One thought: The ability to conveniently get this onto a 240v circuit would be nice. Having to find two different 120v circuits to plug this into will be a pain for many folks.
- wat10000 7mo agoIf you’re spending $65,000 on this thing, needing two circuits seems like a minor problem
- ivraatiems 7mo agoThe $12,000 one also requires it.
- isatty 7mo agoSurprisingly affordable but I’m not really interested in the 9070XT. If it shipped with like 4090+ (for a higher price) it’d be more tempting.
- dmarcos 7mo agoThey offered a version a few months ago with 4x5090 for 25k https://x.com/__tinygrad__/status/1983917797781426511 https://x.com/__tinygrad__/status/1983917797781426511 Stopped due to raising GPU prices: https://x.com/__tinygrad__/status/2011263292753526978 https://x.com/__tinygrad__/status/2011263292753526978
- ycui1986 7mo ago9070XT provide roughly same inference performance at double the power, half the cost, as RTX PRO 4500. So this one is optimized for total BOM cost.
- knollimar 7mo agoEasier to get two circuits than rewire a breaker in an office you might be renting, no? (I work for an electrical contractor so my sense of ease might be overcorrecting)
- markdown 7mo agoAnd 240v is orders of magnitude more common worldwide than 120v
- wat10000 7mo agoThe specs show that it only has one PSU. The docs just say that it has 2 and thus needs two circuits, but I’d guess that was meant to be for the more expensive one.
- ycui1986 7mo agothey could had gone with the Max-Q version RTX PRO 6000 and only require 120V circuit. 10% performance hit, but half the power. fundamentally, looks like they are shipping consumer off-the-shelf hardwares in a custom box.
- ericd 7mo agoYeah, the other big benefit is that the Max-Q's have blowers that exhaust the hot air out of the box, the workstation cards would each blow their exhaust straight into the intake of the card behind it. The last card in that chain would be cooking, as the air has already been heated up by 1800W, essentially a hair dryer on high. Or could be the server edition 6000s that just have a heatsink and rely on the case to drive air through them, those are 600W cards.
- trollbridge 7mo agoA typical U.S. 240V circuit is actually just two 120V circuits. Fairly trivial to rewire for that.
- doubled112 7mo agoI’ve actually had half of my dryer outlet fail when half of the breaker failed. Can confirm.
- amluto 7mo agoSometimes. 240V circuits may or may not have a neutral.
- jcgrillo 7mo agoIf you actually use two 120V circuits that way and one breaker flips the other half will send 120V through the load back into the other circuit. So while that circuit's breaker is flipped it is still live. Very bad. Much better to use a 240V breaker that picks up two rails in the panel.
- ycui1986 7mo agoi am guessing, without any proof, that, when one breaker fails the server lose it all, or loose two GPUs, depending on whether one connected to the cpu side failed.
- fc417fc802 7mo agoGPUs aren't electrically isolated from the motherboard though. An entire computer is a single unified power domain. The only place where there's isolation is stuff like USB ports to avoid dangerous ground loop currents. That said I believe the PSU itself provides full isolation and won't backfeed so using two on separate circuits should (maybe?) be safe. Although if one circuit tripped the other PSU would immediately be way over capacity. Hopefully that doesn't cause an extended brownout before the second one disables itself.
- amluto 7mo ago
- Lerc 7mo agoI am a little surprised that they openly solicit code contributions with "Invest with your PRs" but don't have any statement on AI contributions. Maybe the volume for them is ok that well-intentioned but poor quality PRs can be politely(or otherwise, culture depending) disregarded and the method of generation is not important.
- KeplerBoy 7mo agoTinygrad sure shared a few opinions on AI PRs on Twitter. I believe the gist was "we have Claude code as well, if that's all you bring don't bother".
- all2 7mo agoThat's a pretty excellent take, IMO. Just an undirected AI model doesn't do much, especially when the core team has time with the code, domain expertise, _and_ Claude.
- cyanydeez 7mo agoI'm starting to think that if you have an AI repo thats basically about codegen, you should just close all issues automatically, the manually (or whatever) open the ones you/maintainers actually care about. Thats about the only way to kill some of the signal/noise ratio AIs are creating. Then you could focus fire, like the script kiddies did with DDoS in the old days on fixing whatever preferred issues you have.
- solarkraft 7mo agoI find that the most respected writing about AI has very few signs of being written by AI. I'm guessing that's because people in the space are very sensitive to the signs and signal vs. noise.
- Aperocky 7mo agoI found it useful to preface with * this section written by me typing on keyboard * * this section produced by AI * And usually both exist in document and lengthy communications. This gets what I wanted across with exactly my intention and then I can attach 10x length worth of AI appendix that would be helpful indexing and references.
- jolmg 7mo ago> attach 10x length worth of AI appendix that would be helpful indexing and references. Are references helpful when they're generated? The reader could've generated them themselves. References would be helpful if they were personal references of stuff you actually read and curated. The value then would be getting your taste. References from an AI may well be good-looking nonsense.
- cgio 7mo agoI agree wholeheartedly, I don’t see any balance in the effort someone dedicated to generating text vs me consuming it. If you feel there’s further insight to be gained by an llm, give me the prompt, not the output. Any communication channel reflects a balance of information content flowing and we are still adjusting to the proper etiquette.
- Aperocky 7mo ago"The user could have written the code themselves" Yes, sometimes this is true, but not always. Note, it's not one prompt (there aren't really "one prompt" any more, prompt engineering is such a 2023-2024 thing), or purely unreviewed output. It's curated output that was created by AI but iterated with me since it goes with and has to match my intention. And most of the time I don't directly prompt the agent any more. I go through a layer of agent management that inject more context into the agent that actually work on it.
- deleted 7mo ago[deleted]
- adrianwaj 7mo ago"locally-trained models for everyone" Wouldn't there be a massive duplication of effort in that case? It'll be interesting to see how the costs play out. There are security benefits to think about as well in keeping things local-first.
- all2 7mo agoThere are multiple efforts for 'folding at home' but for AI models at this point. I get the impression that we will see a frontier model released this year built on a system like this.
- jofzar 7mo agoGood? That's what I want out of all websites. I don't want to read what an AI believes is the best thing for a website, I want to know the honest truth.
- imjustmsk 7mo agoBig companies are pushing cloud really hard, and yea the hardware prices too is a problem. People still buy Google cloud and OneDrive when they could literally pickup an old computer from trash and Frankenstein it into a NAS server.
- kube-system 7mo agoWhen you’re dealing with this kind of power it’s easier just to colocate where you’ll typically get two separate feeds of 208v
- agnishom 7mo agoI don't view this as irony. This seems like good sense in understanding when AI usage will make things better and when it will not.
- harvey9 7mo agoIf I'm spending at least 12k USD on the machine then doing some electrical works to accommodate it is not a big deal.
- aiiizzz 7mo agoWhy is hn so obsessed Scott whether something is _written_ by ai or not? Who cares? Judge content, not form. Oh wait, I get it, it's bike shedding.
- dddgghhbbfblk 7mo agoI've been seeing variations on your comment a lot on HN lately and I find it a rather vapid way of looking at something so intricate as human communication. Among other things, the medium is the message!
- nutjob2 7mo ago3200W at ~240V is ~15A, that's just a regular household socket, at least in Europe. I imagine 240V sockets in the US are at least 15A. No need for separate circuits, just use a double adapter.