3 ms·
Unfortunately, at least as of last time I evaluated it, it still can't handle certain things that are currently only done with pickling in the Python ecosystem.
by bunderbunder 2y ago
Unfortunately, at least as of last time I evaluated it, it still can't handle certain things that are currently only done with pickling in the Python ecosystem. Much of what's covered by scikit-learn's feature_extraction package, for example.
Not, I think, for any reason that's inherent to what those components are doing; a lot of it's just that much of the existing Python ML ecosystem was not engineered with robust productionization in mind. Possibly because the very existence of Pickle means everyone has an easy (if horrifying) way to get the job done for 0 effort. As the sklearn maintainers remind people every time they close an issue that asks for it, robust and secure model serialization is something that would have had to have been designed into the project from day 1, and doing it now would essentially require a rewrite.
- kitchen_sink 2y agoIt’s still a WIP but skops (https://skops.readthedocs.io/en/stable/ https://skops.readthedocs.io/en/stable/) may be of interest (for secure sklearn serialization)