3 ms·
As far as training your users on efficient queries do you leverage WLM queues to push the worst queries into a longer running queue? It sounds like you are dea
by mulmen 9y ago
As far as training your users on efficient queries do you leverage WLM queues to push the worst queries into a longer running queue?
It sounds like you are dealing with a lot of data. You say you are using SSDs but also that you have petabytes of data. The max size for a Redshift cluster with SSDs (dc1.8xlarge) is 326TB. Do you only keep a subset of your data in Redshift? How much data are you loading on a daily basis?
Another comment suggested using EMR to create the rollups, have you looked at using a second cluster of dc2.8xlarge instances for rollups? Have you looked at Spectrum?
I'd love to hear your experiences and solutions because it sounds like you're pushing Redshift to it's limits.