6 ms·
it's not about efficiency - it's about availability H100 is not an everyday product. Laptop is
by NooneAtAll3 1y ago
it's not about efficiency - it's about availability
H100 is not an everyday product. Laptop is
- KeplerBoy 1y agoStill, I don't think the m4 is going to be far off from the h100 in terms of energy efficiency. edit: fixed typo
- Der_Einzige 1y agoAt this point, given how many H100s there are in existence, it’s basically an everyday product.
- logicchains 1y agoI envy you if $25k is an everyday product cost.
- jeroenhd 1y agoFor what it's worth, most of the world can't afford an M4 Macbook either.
- wongarsu 1y agoAnd renting an H100 for an hour is a lot easier than renting an M4 MacBook for an hour.
- falcor84 1y agoMaybe not to buy one, but to rent one. Like how barista-made coffee is an everyday product even though most people can't afford a fancy professional coffee machine.
- bee_rider 1y agoReasonably high quality coffee machines are very widespread. Or you can do pour-over. I don’t think the cost of a machine is a limiting factor for many people, it is just convenience. Maybe an analogy could be made to espresso, nice espresso machines get costlier. But, you can still get quite good results out of a manual machine like a Flair. I think this is why the suggestion to rent a machine is not to helpful. In this analogy we’re on BaristaNews, we all know about the industrial machines, lots of folks use them at work. But, the topic of what sort of things you can do on your manual machine at home has come up.
- inetknght 1y ago> Reasonably high quality coffee machines are very widespread. Or you can do pour-over. I don’t think the cost of a machine is a limiting factor for many people No, reasonably-priced coffee machines is an enabling factor for many people. If coffee machines weren't reasonably priced, they would not be "very widespread".
- bee_rider 1y agoI’m not sure I follow your deeper meaning here, sorry.
- Sharlin 1y agoH100s are almost-instantly available to anyone with a credit card and access to the internet. Without even having to lift their butt from the seat. And you get plenty more than five minutes of compute for the price of an M4.
- jsperson 1y agoFor the orgs where I've worked the important thing isn't availability of compute it's security. Using what we have on our local network is much easier from a governance and approval standpoint than whatever is available on the internet.
- Sharlin 1y agoMany orgs have no problems using cloud envs for most things. The usual suspects offer just as secure compute envs as everything else. Anyway, I was assuming personal use, like the messing-around experimenting that the article is about. (Or who knows, maybe it was part of the author’s job.)
- potatolicious 1y agoAnd yet just about any intro-to-programming tutorial gets something running on your local machine, and local machine development continues to be the default for most people, even though devving on a cloud machine is eminently reasonable. "Pull out credit card, sign up for some thing and pay a bit of money" is a non-trivial bit of friction! Extremely non-trivial! Especially in a corporate context - you have to get the expense approved. It's not clear if you can put company data onto the machine. Whereas generally running local things on corporate laptops is far less controversial. "Download this tool and run it." is still an extremely powerful pitch. Pretty much the only thing that beats it is "go to this website which you can use without any signup or payment".
- Sharlin 1y agoSure, if you already have said local machine. Which I guess in HN’s context many/most do.
- nickpsecurity 1y agoAlso, my laptop running Linux and its outputs are probably mine and private. If I use cloud GPU's, I need to be a lawyer to be sure what they can or can't do with my data or models. There's also no overages or hidden charges with a laptop. Past simply breaking it. You know the replacement cost ahead of time, though.