4 ms·
Out of curiosity, do they have any functionality for dealing with larger than memory datasets?
by IndianAstronaut 12y ago
Out of curiosity, do they have any functionality for dealing with larger than memory datasets?
- fermigier 12y agoThis will be addressed in the following years by the WENDELIN project (http://www.wendelin.io/ http://www.wendelin.io/) which has recently been financed (well, we're still waiting for the contracts and the money, actually) by the French government.
- wlamond 12y agoSort of. There are out-of-core learning algorithms (e.g. SGD) that work on data that doesn't entirely fit in main memory. Please see: http://scikit-learn.org/stable/auto_examples/applications/plot_out_of_core_classification.html http://scikit-learn.org/stable/auto_examples/applications/pl...