Having them available is still hugely beneficial, even if they end up too expensive to use in most production use-cases. They would still be valuable for proto

Having them available is still hugely beneficial, even if they end up too expensive to use in most production use-cases. They would still be valuable for prototyping, where fast iteration makes it possible to learn more about the problem you are solving and whether it is even worth solving. They are also valuable for iteration-and-distillation approaches, where you can use the data generated from an expensive model to train a cheaper model.