4 ms·
I doubt the price will go up that much, if at all. Maybe there will be more expensive tiers, but $20 will probably stay. Between better quantization, pruning,
by Klaus23 3y ago
I doubt the price will go up that much, if at all. Maybe there will be more expensive tiers, but $20 will probably stay.
Between better quantization, pruning, smaller models through better training/distilling/architecture, hardware price drops and purpose-built hardware, it will probably be much cheaper to run such a model in the future.