3 ms·
As a specific sub question, all HN data is stored in BigQuery. Is the data updated close to realtime and does dang uses any GCP tool to moderate content?
by wanderingmind 4y ago
As a specific sub question, all HN data is stored in BigQuery. Is the data updated close to realtime and does dang uses any GCP tool to moderate content?
- jhugo 4y agoIt doesn't seem like anywhere near enough data to need "big data" tools for moderation. A moderator for HN can simply skim-read what's posted, with a bias towards stuff that's on or near the front page (since there is little sense in moderating stuff the community has already moderated themselves).
- smt88 4y agoThere's a lot of automated moderation too that's intended to prevent brigading, spam, astroturfing, etc. If you consider that HN logs every hit, click, vote, thread collapse, etc., then it is big data.
- deleted 4y ago[deleted]
- dang 4y agoIt's not really big data by modern standards. Something like 13M lines of logging a day and less than 1.5 GB.