derekalyon

3 ms·

1. 1.▲
   by derekalyon 8y ago

   We are using dedicated clusters to push data over the links. A member of our team proposed a session for Google NEXT '19 that goes into the architecture we are using in a lot more depth. We're waiting to see if that talk is accept
2. 2.▲
   by derekalyon 8y ago

   Yeah! We’ll be operating in a hybrid model steady-state, so the links aren’t just for the one-time copy.
3. 3.▲
   by derekalyon 8y ago

   Indeed, these workloads are bursty. They also tend to involve running lots of different processing frameworks over the same data, which makes the value proposition for separating compute and storage stronger.
4. 4.▲
   by derekalyon 8y ago

   This is Derek. We shared a bunch of stuff in this video: https://youtu.be/4FLFcWgZdo4 One of the interesting benchmarks was GridMix performance at scale. And overall performance for throughput-oriented workloads like Hadoop
5. 5.▲
   by derekalyon 8y ago

   This is Derek, from the video. Sorry I am just joing the conversation mow. For this use case, we setup 800 Gbps of interconnect with Google.