distributed ml tends not to work well on aws. Many (most?) distributed ml algorithms are essentially limited by network speed. In a p2p topology, many are eff

distributed ml tends not to work well on aws. Many (most?) distributed ml algorithms are essentially limited by network speed. In a p2p topology, many are effectively limited by the slowest peer-to-peer link of the (nodes choose 2) links. aws networking is mediocre at best; even the rack-local instances are relatively slow. cred: helped build a distributed in-memory ml toolkit