4 ms·
That assumes that we have enough RAM to hold all of the data we could ever want to analyse and that we have this data at startup. Neither of which has ever been
by skgoa 8y ago
That assumes that we have enough RAM to hold all of the data we could ever want to analyse and that we have this data at startup. Neither of which has ever been the case as far as I have personally experienced.
- xgbi 8y agoMy friend works for $financial_subcontractor and he told me they have an XmX of 1,46TB on their servers so that they can load the data needed for market analysis. The response time is quite fantastic (less than a minute), but there are drawbacks: - GC takes in the order of minutes to complete - loading the data takes 90 min from spinning rust So yeah, it's possible, but your bottleneck becomes the storage driver.
- neuro 8y agoI've seen that setup in a number of hedge funds
- majewsky 8y agoIt's not uncommon for in-memory database servers to have installed RAM in the order of multiple terabytes. Source: I work at SAP's internal cloud team. For our internal customers running SAP HANA, we offer baremetal machines with up to 6 TiB RAM.