4 ms·
This is spot on. There are "highly scalable environments" which are flexible and generic, and then there are local focused tools, by their nature optimized in a
by Radim 8y ago
This is spot on. There are "highly scalable environments" which are flexible and generic, and then there are local focused tools, by their nature optimized in a way generic frameworks can never be.
Think ancient tools like grep versus Hadoop or Spark. Or our word2vec in Gensim vs word2vec in Spark or Tensorflow.
The occasional recalibration between "OMG-big-O-toward-infinity!-need-scale" versus "our-data-is-actually-finite-what's-a-good-operational-compromise" is a worthwhile exercise.