saturn99

3 ms·

1. 1.▲
   by saturn99 3y ago

   I think FPGAs would be an awesome prototype but maybe too constricting in terms of resources? The extrapolation might be so far out to be just as accurate as their simulated model...
2. 2.▲
   by saturn99 3y ago

   Seems to align with Google, seems like they release a new TPU every 1.5 to 2 years. I think modern LLMs are powerful enough now that they will still be useful in a couple years even if they aren't state-of-the-art. ChatGPT still lets y
3. 3.▲
   by saturn99 3y ago

   Yep, pretty unique system. I imagine anything that runs LLMs better than we currently can would pique the interest of VCs.
4. 4.▲
   by saturn99 3y ago

   I think the costs are from the Moonwalk model, which is a pretty good reference for estimating costs, although it might be low if you use all Google engineers to build the HW. =P