3 ms·
We were pulling the entire list of tasks (around 80,000 tasks from various projects) from Microsoft Project 2012 (MSP) and dumping it into a database every day,
by prometheus76 2y ago
We were pulling the entire list of tasks (around 80,000 tasks from various projects) from Microsoft Project 2012 (MSP) and dumping it into a database every day, so that we could track progress of projects daily. MSP uses GUIDs and they are great for uniqueness, but the memory footprint they caused when reporting using Power BI became untenable after about six months.
We ended up creating our own integer table tied to the GUIDs and replaced all the GUIDs with integers in our reporting database. Our memory footprint dropped by 10X and we were able to report on years worth of data, rather than months.
- CodesInChaos 2y ago> Our memory footprint dropped by 10X How? A UUID is only 4x the size of a 32-bit integer.
- prometheus76 2y agoWe had multiple columns using UUID that we needed, and the Tabular memory model goes up exponentially for every column.