Yup, I've seen on the graph it looks like at least an order of magnitude more training time until it starts to get interesting. Obviously this is only one examp

Yup, I've seen on the graph it looks like at least an order of magnitude more training time until it starts to get interesting. Obviously this is only one example, so that factor might vary mightily. It might be an option for someone who is really serious about squeezing out the last drop of generalisation performance. I guess we'll see how things work out, because some folk are bound to try.