20 ms·
Is there any way to purchase anything like a TPU? I guess the Cerebras Andromeda product is one, but I don't know if those are sold or leased. Any others? http
by CGamesPlay 4y ago
Is there any way to purchase anything like a TPU? I guess the Cerebras Andromeda product is one, but I don't know if those are sold or leased. Any others?
https://www.cerebras.net/andromeda/ https://www.cerebras.net/andromeda/
- wiz21c 4y agoFrom the page : "Andromeda, a 13.5 Million Core AI Supercomputer". Blown away by the number of cores (I considered myself lucky to have 2 10000+ cores GPU in my workstation) I then realized that the word "core" is singular in the sentence. Is it just a mistake or does it mean something else ? (genuine question, English is not my first language) EDIT: Ahhh a bit below on the page it is written "13.5 million AI-optimized cores" and there it's plural. So it was probably just a mistake.
- fastball 4y agoIt is not a mistake, that is how you phrase it in English when the noun ("core" in this case) is being used as part of a compound adjective. The convention is to keep the noun singular. e.g. "He commanded a ten thousand man army." (not men) "Andromeda, a trillion star galaxy, is 2.5 million lightyears away." (not stars) etc
- tobr 4y agoNot a native English-speaking person, but shouldn’t it be "He commanded a ten-thousand-man army" and "Andromeda, a trillion-star galaxy, is 2.5 million lightyears away"?
- fastball 4y agoI am a native speaking English-speaking person, and although I think you are correct in that compound adjectives have historically been connected with hyphens, that seems to have fallen out-of-fashion somewhat.
- ben_w 4y agoI'm now remembering some WW1 posters from my GCSE History lessons that hyphenated "to-day" like this: https://www.pinterest.com/pin/483644447456350306/ https://www.pinterest.com/pin/483644447456350306/
- adastra22 4y agoThat’s optional, but definitely more clear. The kind of thing a newspaper editor would insist on, but not necessarily seen outside of that.
- deleted 4y ago[deleted]
- CGamesPlay 4y agoTo expand on the sibling comment, this is when pedantic people start talking about hyphenation. The clearer way to say this is "13.5-million-core AI supercomputer".
- svantana 4y agoYes, Google TPUs are sold to consumers under the Coral brand. https://coral.ai/products/ https://coral.ai/products/
- CGamesPlay 4y agoThis is certainly interesting, but doesn't seem quite like what I want. It only seems to offer "Edge TPUs" which... > The Edge TPU ... supports only TensorFlow Lite models that are fully 8-bit quantized and then compiled specifically for the Edge TPU.
- mgraczyk 4y agoIt's a different chip
- versteegen 4y agoClearly; they're tiny and for embedded applications. They even wrote "The products offered by Google are unrelated to the products offered under the CORAL trademarks" in the page footer.
- jamesralph8555 4y agoThese things come with a lot of limitations, like not being able to work with 4D and larger tensors, plus the 8 bit quantization. Getting models to run on them is a real pain.
- bufo 4y agoThis is like saying Fisher Price toy cars are equivalent to F1 cars.
- dna_polymerase 4y agoAbsolutely. On an hourly basis. Support is extra. https://cloud.google.com/tpu/pricing https://cloud.google.com/tpu/pricing
- terafo 4y agoRenting isn't purchasing.
- amrb 4y agoCerebres systems are whole rack with high cost and cooling requirement, pci cards are more sensible for home gamers: https://tenstorrent.com/ https://tenstorrent.com/
- cossatot 4y agoHow useful are these for workstation-class scientific computing, vs. a GPU? Not ML necessarily, but I do a lot of matrix multiplication for example when solving systems of equations.
- VHRanger 4y agoWe dont know yet, because they're not available. But Jim Keller has been all-in there for 2 years and they're supposed to be generally programmable.
- VHRanger 4y agoCant wait for tenstorrent card to come to public. Grayskull is supposed to be A100 performance for $1000, with some cool features (horizontally scalable by plugging them to each other over ethernet, C++ programmable, sparse computation, etc.)
- tucnak 4y agoI really wonder how well it's going to perform given that it's 600 TOPS / 16GB DRAM 200 Gbit/s setup. I was told that in Transformer training, memory bandwidth is key. However, neither 16GB single-card memory capacity, nor bandwidth sounds terribly attractive but most important of all, judging from their FAQ, their driver is likely to be proprietary and would require Internet access which is worrying still. Over the last couple weeks, I've seriously considered purchasing AMD Instinct MI50 (32GB HBM2, 1 Gbit/s) card which goes for under a $1000. I know it lacks Tensor Cores, and can only offer 53 TOPS which sounds silly compared to Grayskull's 600 TOPS. However, isn't it the case that for the most part these cores are idle, & waiting for memory still? At any rate, you're not going be able to run, say Llama 30B which won't fit already into 16GB but must fit comfortably in a 32GB system— on a single card. But perhaps most importantly, amdgpu driver is actually open source and allows PCIe passthrough unlike other vendors so considering all of the above, it almost seems like a no-brainer for a trusted computing setup. I wonder if my logic is correct. MI50: https://www.amd.com/en/products/professional-graphics/instinct-mi50-32gb https://www.amd.com/en/products/professional-graphics/instin...