3 ms·
The discussion seems to have pretty well settled on Google's policies around service deprecation, but in case anyone's interested in chatting about the replacem
by davidmr 9y ago
The discussion seems to have pretty well settled on Google's policies around service deprecation, but in case anyone's interested in chatting about the replacement API, I'm excited about the long-term prospects of their ML Engine product.
The open-source distributed tensorflow stuff is pretty nice, but it still requires a huge amount of hand coding and tuning the machinery, reminding me quite a lot of just rolling the damn thing in MPI yourself. I'm very excited to see where distributed tf will be in a year or two, but it's a chore today.
The hope is that using Google's secret sauce to auto-distribute the execution graphs and associated data ingestion makes things "just work". At the moment, the documentation and examples for that are a bit all over the place at the moment, and require writing models to conform to the newish tf.contrib.learn.Experiment API, which is also a bit underdocumented and underexampled. Using it for very large datasets (say >tens of TB) seems to be pretty challenging at this moment (to me at least).
At any rate, I've been banging around on it for a few weeks and am really hopeful. I will follow Cloud ML Engine's career with considerable interest.