I think it depends on the algorithm. Something like siri trains on a larger data set with better hardware and uses a reduced version on the phone hardware. I

I think it depends on the algorithm. Something like siri trains on a larger data set with better hardware and uses a reduced version on the phone hardware. I think most neural networks can be reduced and compressed into a 'read only' format with limited or no new training, but it's a secondary problem.