2 ms·

Snowplow (I'm a co-founder) can happily scale to billions of events per day: https://github.com/snowplow/snowplow https://github.com/snowplow/snowplow

• e12e 12y ago
  Judging from the repo: "Collectors receive Snowplow events from trackers. Currently we have three different event collectors, sinking events either to Amazon S3 or Amazon Kinesis" (etc) -- it's still not viable to self-host snowplow on own hardware/internal cloud etc? Or is it possible, but you need to run a full cloud? (I understand why one would want a setup that runs on Amazon, if one uses amazon, but when you host your own infrastructure, a self-host option would be nice ... if viable). Without an option to self-host, snowplow isn't really an alternative to pwiki.
  • alexatkeplar 12y ago
    Hey e12e! It's a great question. You are right - at the moment Snowplow is still tied to the AWS cloud; we use a variety of AWS services which support massively horizontal processing, including Elastic MapReduce, Kinesis and Redshift. We are working on a Kafka+Samza version of Snowplow which we will release later this year, most likely running on a Mesos cluster that you can deploy where you want.
    • bjelkeman-again 12y ago
      We have to move away from US hosted services, so we have to wait for the Kafka+Samza version if we go that route. Thanks!