5 ms·
Piwik has the problem that it writes directly to MySQL as the activity happens. If your database is down, you lose data. If you have a spike of traffic above wh
by shermozle 10y ago
Piwik has the problem that it writes directly to MySQL as the activity happens. If your database is down, you lose data. If you have a spike of traffic above what your DB can handle in writes, you lose data.
Snowplow doesn't have this problem.
- moehm 10y agoYou can query your writes in Redis, so it won't be lost if your database goes down. https://piwik.org/faq/how-to/faq_19738/ https://piwik.org/faq/how-to/faq_19738/
- shermozle 10y agoCos your Redis will never go down? Or need to be upgraded? Patched?
- educar 10y agoHow does snowplow solve this problem? By writing to disk?
- alexatkeplar 10y agoSnowplow is implemented as a unidirectional data pipeline: tracking -> collection -> enrichment -> storage Between each step there is typically some kind of persistent queue (mostly S3/Kinesis), and data won't be lost if a downstream component is not operational. Examples: * If your event collector is unavailable, raw events will be cached in the tracker in localStorage, SQLite or similar * If your Redshift database is read-only for maintenance, enriched events will be held back until Redshift is writeable again
- shermozle 10y agoThere is of course the opportunity for a collector to be down, but the aim is to keep those components super simple and rely on really durable storage (Kinesis, S3) managed by someone else.
- JohnBooty 10y agoNote to anybody reading this but not following the link: parent poster means "queue your writes in Redis" and not "query."
- moehm 10y agoI'm sorry, I am not a native speaker and it was already late.
- dsp1234 10y agoThey also have a problem that their password hashing method is still md5[0]. [0] - https://developer.piwik.org/api-reference/Piwik/Auth https://developer.piwik.org/api-reference/Piwik/Auth
- smt88 10y agoPiwik started in 2007. It was inexcusable to use md5 then. The problem is that it was ever md5, not that it is still md5. That really doesn't inspire confidence that they know what they're doing. md5 is a canary in the coal mine for me, and I definitely won't use Piwik now.
- lucb1e 10y agoTo be fair, they aren't an encryption service or something. They INSERT INTO visitor_count. So far as "inspiring confidence" needs to go for such a thing, I wouldn't write them off just yet.