3 ms·
Is gpu good for that? It seems like it is a very niche capability that can't easily be re-purposed the way regular cpu compute could be. I did a lot of projec
by lisbbb 1y ago
Is gpu good for that? It seems like it is a very niche capability that can't easily be re-purposed the way regular cpu compute could be.
I did a lot of projects with Kafka (big data) in cloud environments and companies had big, pie in the sky dreams that came crashing back to reality when they got the bill for compute services. It's happened several times on projects I was on.
- jiggawatts 1y agoOlder GPUs had nowhere near enough memory to be really interesting for big data crunching. Now however, the biggest limit for AI workloads is GPU memory capacity (and bandwidth). The billions invested are going into improving this aspect faster than any other. Expect GPUs with a terabyte of ultra-fast memory by the end of the decade. There are lots… and lots… of applications for something like that, other than just LLMs!