3 ms·
In fairness, you can still reverse engineer the training procedure yourself from their paper and get a close approximation of training cost using some open/synt
by throwaway314155 2y ago
In fairness, you can still reverse engineer the training procedure yourself from their paper and get a close approximation of training cost using some open/synthetic datasets. You might think it's incredibly complicated to do this without source code, but the pre-training portion of the training is something you can grab from other projects or re-derive yourself pretty easily (and will account for the bulk of training time/cost).
Not defending it, but it's a much better situation than some of the non-commercial licensing from e.g. Meta, Stability.