6 ms·
Ironwood, our latest TPU
- shrubble 11mo agoNot much real data or news there.
- bigyabai 11mo ago> It’s designed for AI with AI CUDA engineers, your job security has never felt more certain.
- TrainedMonkey 11mo agoGoogle having their own hardware for training and inference is newsworthy, but the link is pretty bad. Here is a much better source https://blog.google/products/google-cloud/ironwood-tpu-age-of-inference/ https://blog.google/products/google-cloud/ironwood-tpu-age-o...
- bgwalter 11mo agoSo we will be getting wrong answers faster now.
- ragequittah 11mo agoI'll never understand this attitude. Recently I set up a full network with 5 computers, opnsense, xcp-ng and a few things like a pi, switch, AP, etc. I was migrating from pfsense to Opnsense so I wasn't too familiar with some of the nitty gritty. Was migrating to xcp-ng 8.3 from 8.2 which has some major CLI differences. It was a pretty big migration that took me a full weekend. OpenAI got things wrong (mostly because it was using old documentation - opnsense had just upgraded) maybe 8 times in the whole project and was able to quickly correct itself when I elaborated on the problem. If I just had google this would've been a 2 week project easily. I'd have to drudge through extremely dry documentation that mostly doesn't apply to anything I'm doing. Would have to read a bunch of toxic threads demeaning users who don't know everything. Instead I had chatgpt 5 do all that for me and got to the exact same result with a tenth of the effort. The AI is useless crowd truly makes me scratch my head.
- oliwarner 11mo ago> If I just had google this would've been a 2 week project easily. But you'd know something new by the end of it. So many are so fast to skip the human experience element of life that they're turning themselves into mere prompt generators, happy to regurgitate others' knowledge without feeling or understanding. For this, you might not care to gain meaningful experience, and as a conscious choice, that's fine. But there are an increasing number of developer and developer adjacent people who reach for the LLM first. Who don't understand "their" contributions to projects. The haters are those of us who have to deal with this slop, and the sloppy people submitting it without thought, care or understanding.
- tarsinge 11mo agoI don't know, the kind of developers doing this are the same that would copy paste from stack overflow in the past. Because if you are interested in knowledge and human experience, LLMs or not you are curious about what you read and take ownership of what you produce. In the past these developers would have created the same slop but at a much slower pace, LLMs are just enabling them to do it faster.
- oliwarner 11mo agoIt's the speed that stops you learning anything. Piecing together a dozen scripts from a dozen sources and making them work requires some work. You have to debug it. Some of this knowledge sticks. It's not just a tech thing. Kid's learning suffering at their ability to just crank out essays they've never even read. LLMs and AI are getting better. We doomers aren't decrying the technical advances they're making, we're appalled at the human cost of giving people a knowledge-free route through life.
- fragmede 11mo agoNot just knowledge free, but thought free. Instead of thinking deeply about something and coming to a conclusion yourself, just offload it to an AI to do it for you. Something challenges you in life? No worries, AI is here. Not just to answer your questions, but think for you. What kind of world is that? What kind of society will that lead to?
- gorbot 11mo agoI'm an idiot and I know nothing But I wonder if there could be room for an ARM-like spec that Google could try and own and license but for AI chips. Arm is to risc-cpu as google-thing is to asic-aichip Prolly a dumb idea, better to sell the chips or access to them?
- eru 11mo agoI'm not sure the chip spec (or instruction set) is the level of abstraction here? Something like DirectX (or OpenGL) might be the better level to target? In practice, CUDA is that level of abstraction, but it only really works for Nvidia cards.
- latchkey 11mo ago> CUDA is that level of abstraction, but it only really works for Nvidia cards. There are people actively working on that. https://scale-lang.com/ https://scale-lang.com/
- karmakaze 11mo agoIt's not that it only works on Nvidia cards, it's only allowed to work on Nvidia cards. A non-clean room implementation of CUDA for other hardware has been done but is a violation of EULA (of the thing that was reverse engineered), copyright on the driver binary interface, and often patents. Nvidia aggressively sends cease-and-desist letters and threatens lawsuits (successfully killed ZLUDA, threatened others). It's an artificial (in a technical sense moat).
- jeffbee 11mo agoThese are only available in Iowa on GCP, which to me raises this question: do they have them all over the world for their own purposes, or does this limited geography also mean that users of Google AI features get varied experiences depending on their location?
- wmf 11mo agoRunning on v6 vs v7 should just be different performance.
- jeffbee 11mo agoIf a search feature runs on a deadline then different performance could be observable as more work done in 100ms or whatever unit of time.
- londons_explore 11mo agoThings needing the most compute (llm's, image and video generation) tend not to be latency sensitive. 100ms of latency is nothing when added to 10 seconds of generation time.
- aurareturn 11mo agoI think we need an analysis of tokens/$1 and tokens/second for Nvidia Blackwell vs Ironwood.
- ipnon 11mo agoIt depends on how they’re utilized , especially at these scales, you have to squeeze every bit out.
- htrp 11mo agoSo what's the difference between their announcement in april and now?