4 ms·
About how many training steps are required to get good output?
by msla 8mo ago
About how many training steps are required to get good output?
- b44 8mo agonot many. diminishing returns start before 1000 and past that you should just add a second/third layer
- WatchDog 8mo agoI trained 12,000 steps at 4 layers, and the output is kind of name-like, but it didn't reproduce any actual name from it's training data after 20 or so generations.
- alansaber 8mo agoDepends on the model size, batch size, input sequence length, ... etc. With a small model like this you'll never get a 'good' output but you can maximise its potential.