4 ms·
But is this going to blow over in a few days? Again? I can certainly appreciate frustration with the AMD stack, but be blunt, I was not impressed with Hotz's Y
by brucethemoose2 3y ago
But is this going to blow over in a few days? Again?
I can certainly appreciate frustration with the AMD stack, but be blunt, I was not impressed with Hotz's YouTube rant from before.[1] It didn't give the impression of a stable framework, and this doesn't either.
Also (at least from the end user llm inference side of things) ROCm is not nearly as unusable as it used to be. We would certainly be renting MI300s over A100s (or even H100s) if we could get any, and we use a number of different inference backends.
1: https://news.ycombinator.com/item?id=36193625 https://news.ycombinator.com/item?id=36193625
- jauntywundrkind 3y agoThe post PC era of big expensive hardware you can't even buy if you do have the money is upon us, and mercy this is a scary scary time in computing for me/us.
- smoldesu 3y agoBesides the datacenter stuff, what exactly are people struggling to source these days? The 30/40-series prices should be fairly stable relative to the MSRP these days.
- brucethemoose2 3y agoUsed 3090 prices are absolutely outrageous. And the 4090 MSRP was outrageous to begin with.
- brucethemoose2 3y agoI was talking about renting! There are some boutique hosts like Hot Aisle serving MI300s (who I really should reach out to), but for the immediate future our little startup is stuck with the big cloud providers. No MI300s for us mere mortals, not even to rent.
- pjmlp 3y agoYet another thing to go back to 1990's ecosystem. We already have timesharing again, now we have the prices as well.
- whalesalad 3y agohe's always been nails on a chalkboard for me. rant, whine, cry, repeat. reminds me of larry david with a CS degree.
- brucethemoose2 3y agoI never followed Hotz, so perhaps I missed something cool. But I never understood the hype myself.
- deleted 3y ago[deleted]