4 ms·
The learning coefficient decreases over time making the model less plastic.
by personjerry 7y ago
The learning coefficient decreases over time making the model less plastic.
- vankessel 7y agoOnly because you have chosen for the learning rate to decrease over time so the model converges. You could reset it. I would even argue the LR is not relevant to plasticity, it's a meta-variable for training the model and not to do with the model itself. A plastic model would be one that could accomplish a given task after being trained on it, and then trained on a second task while maintaining the ability to accomplish the first task.