11 ms·
I work with a platform that fits exactly into the big iron use case. A typical machine will host millions to billions of rows of transactional data in memory. T
by bmh100 11y ago
I work with a platform that fits exactly into the big iron use case. A typical machine will host millions to billions of rows of transactional data in memory. The round time from a user interaction to fully joined (across several or dozens of tables), aggregated (across several dimensions), and visualized data rendered by the client browser is expected to be less than 2 seconds. Each second of wait is an exponential cost to user experience. Yes, you have a single machine with dozens to hundreds of GB of RAM. You also have a responsive analytics experience, and that value makes it all worthwhile.
- nickpsecurity 11y agoCurious, what's your hardware configuration for that?
- bmh100 11y agoI mainly work on the smaller side of servers, so you would be looking at Intel Xeon or i7 2.8-3.2 GHz (4-8 cores), 16-32 GB RAM, Windows Server 2008, a 100+ GB SSDs in RAID, 1 TB HDD, with nightly backups. Interestingly, management analytics applications can handle longer downtime than operational systems, so a full system restore from the nightly backup is an acceptable process. Data can recovery can just be performed without downtime, with background processes and zero-downtime database updates.
- nickpsecurity 11y agoInteresting. Especially them doing a nightly restore. Many forget to ensure the restore process will work as well as the backup. That company will probably have no problem there. :)
- bmh100 11y agoThe restore is only as-needed, but full system image backups are made every night.
- nickpsecurity 11y agoAh OK. It was too original and extreme to be true. :)
- deleted 11y ago[deleted]
- GFK_of_xmaspast 11y agoI've got "dozens of GB of ram" in my desktop, and you can get a 64GB stick on amazon for under $400.
- bmh100 11y agoIf you have 24 GB of RAM, then you are certainly a rare breed. Curious, what motivated you to install so much?
- vinkelhake 11y agoI've got 32GB in my three year old workstation and 16GB in my laptop. Memory is cheap, so why not?
- xresonance 11y agoI've got 64GB, and will double it when I get the other CPU socket populated (bloody expensive Xeons!) This is because I work with giant data sets, in this case, digital video, specifically cinema-quality stuff spit out of a RED camera. I'd do the same with any other large data sets, databases, analytics, etc. RAM is inexpensive compared to the time saved by having data rapidly accessible. Even arguable for web surfing and other light desktop stuff. We can never get more time, but we can make the machines quicker and piles of RAM are a good way to do it.
- ChuckMcM 11y agoIs it ECC protected?
- beachstartup 11y agoalmost certainly, if he's running xeons. my xeon mac pro is 6 years old and it has it. i can't imagine running that much ram without ecc. you would kernel panic or spontaneously reboot constantly. not to mention silently corrupt half your work...
- 11y ago
- mabbo 11y agoA lot of large companies got onto Oracle a decade or two ago, and now are at a scale where Relational DBs are just not quite enough- but getting off them isn't fast or easy either. All that's left is a Big Iron, while a new architecture is figured out.
- bmh100 11y agoAre you referring to row-store, hard-disk DBs (especially data warehouses) or column-store, in-memory DBs?