4 ms·

Thanks. The cloud could work. I was hoping to use any idle time with building models of the data. Any thoughts what physical hardware would be beefy yet cost e

• bradknowles 8y ago
  Your largest dataset is ~100MB, right? I would think that any VM that has at least 2-3 times this amount of memory free after the OS is loaded (and your other critical apps are loaded) should be a good place to start. But your data and your own testing will be your best guide — try something you think might work, and if you’re not happy with the speed or the system seems to be thrashing too much, then try the next size up. Or maybe try a different model that has a different mix of permanent storage versus CPU performance versus RAM. But you will need to do some testing here on your own, and see what feels right for you and the amount of money you’re willing to spend. In that regard, I would try starting off with some of your biggest data sets and use those as your current worst case for testing. Then keep an eye on how your data sets change over time, to see if you need to go re-do your testing.