maybe, but model quality doesn't scale linearly with model size. The performance/dollar metric is more important, and that definitely will decline over time. P

maybe, but model quality doesn't scale linearly with model size. The performance/dollar metric is more important, and that definitely will decline over time. Personally, I have a boots trapped business that uses a transformer model. I'm not worried about supermassive models like gpt3 because it would be way too expensive to deploy for my use case, with marginal additional quality.