3 ms·
Amazing! Training the model, although it is small with only 15M parameters, takes quite some compute power. I wonder if the resources would have been sufficien
by xenonite 3y ago
Amazing!
Training the model, although it is small with only 15M parameters, takes quite some compute power. I wonder if the resources would have been sufficient at the time. Also, I wonder if disk space would have been sufficient to store the input corpus.