3 ms·
I work in VFX and we have 1 primary 1 replica for the render farm (MySQL), and another one for an asset system. They both have 100s of TBs many cores and a lot
by aprdm 5y ago
I work in VFX and we have 1 primary 1 replica for the render farm (MySQL), and another one for an asset system. They both have 100s of TBs many cores and a lot of RAM, we treat them a bit like unicorn machines (they're bare metal), which isn't ideal, but yeah.. our failover and whatnot is to make the primary the replica and vice versa.
I cannot imagine reprovisioning it very often, when I worked in startups and used rds and other managed DBs it was easier to not have to think about it.
- mhitza 5y agoWhy are those so big? Are you storing binary data (assets) within the tables? Or it just has old historical records that were never "warehoused"?
- aprdm 5y agoWe run a lot of workflows in our systems, we keep a rolling window of 3 months for the farm data, the rest goes to a warehouse system. For the asset we keep for a show duration and we have many shows being worked from many studios. We don’t have binary data in them
- KaiserPro 5y agoAs an ex VFX sysadmin, I feel your pain. Any kind of recovery needed for that sized array takes days, so I feel your pain there.