3 ms·
> For example, GPT Sol baked into a custom chip run for $100M that runs 10x as fast and 10x as cheap should pay for itself as long as the chip is useful for lon
by andsoitis 2mo ago
> For example, GPT Sol baked into a custom chip run for $100M that runs 10x as fast and 10x as cheap should pay for itself as long as the chip is useful for long enough.
but you trade updatability, which I don't think is worth it yet.
- mchusma 2mo agoMaybe! (1) Would SOL level intelligence be useful 3 years from now? 5 years? (2) would dedicated chips be the most affordable way to run this model in 3-5 years? I suspect the answer to both of these questions is yes right now, but I agree it’s borderline.
- andsoitis 2mo ago3 years is an eternity.
- imtringued 2mo agoLoRAs are a parameter efficient way to update models. The fine tuning stopgap only has to work long enough to extend the lifespan of a model until the next chip comes out.