They have techniques to reduce the data corpus, called "massive volume reduction" or MVR in the GCHQ "Mastering the Internet" rather pompously named leak. It di

They have techniques to reduce the data corpus, called "massive volume reduction" or MVR in the GCHQ "Mastering the Internet" rather pompously named leak. It discards junk traffic and assumedly does deduplication, etc. Remember, Tempora went online in 2011, 6 years ago. Techniques have certainly been refined since. [1] https://www.theguardian.com/uk/2013/jun/21/gchq-cables-secret-world-communications-nsa https://www.theguardian.com/uk/2013/jun/21/gchq-cables-secre... [2] https://www.theguardian.com/uk/2013/jun/21/gchq-mastering-the-internet https://www.theguardian.com/uk/2013/jun/21/gchq-mastering-th...