4 ms·

Any context? Is this a real live feed or is it some simulation (the URL is a part of this confusion, given it sends to play.trytrench.com)? If real, then how a

Any context? Is this a real live feed or is it some simulation (the URL is a part of this confusion, given it sends to play.trytrench.com)? If real, then how are you fetching the data? Is it truly real time? Did you process it beforehand and then serve? Like, the whole thing seems neat, but I am also struggling to really figure out the what and the why and the how. Perchance having a simple “About” page somewhere on the website would be helpful.

pavel_lishin 3y ago
The blog post linked in the text explains all of the above.
diggan 3y ago
I'm guessing it's basically a UI on top of https://docs.github.com/en/rest/activity/events?apiVersion=2022-11-28#list-public-events https://docs.github.com/en/rest/activity/events?apiVersion=2... or similar, which is delayed by five minutes according to the docs.
legitmaxwu 3y ago
Hi, poster here. GitHub exposes an event stream of all public events: https://docs.github.com/en/rest/activity/events?apiVersion=2022-11-28 https://docs.github.com/en/rest/activity/events?apiVersion=2... We send these events directly to Trench (the monitoring tool we built). We then use Trench to extract entities (users, comment simhashes, repos, etc.) and other features via a data model we configure through the app (view on desktop only): https://play.trytrench.com/settings https://play.trytrench.com/settings Everything happens in real time—we are able to label spam within milliseconds of receiving the event. Note that the public GitHub event stream is usually around 5m behind real time. We built this because there’s been spam on GitHub lately (see https://djanes.xyz/spam-on-github-is-getting-crazy-these-days https://djanes.xyz/spam-on-github-is-getting-crazy-these-day...) and we wanted to see if we can catch it. Blog with more details: https://www.trytrench.com/blog/preventing-spam-and-fake-stars-github https://www.trytrench.com/blog/preventing-spam-and-fake-star...

pavel_lishin 3y ago

The blog post linked in the text explains all of the above.

diggan 3y ago

I'm guessing it's basically a UI on top of https://docs.github.com/en/rest/activity/events?apiVersion=2022-11-28#list-public-events https://docs.github.com/en/rest/activity/events?apiVersion=2... or similar, which is delayed by five minutes according to the docs.

legitmaxwu 3y ago

Hi, poster here. GitHub exposes an event stream of all public events: https://docs.github.com/en/rest/activity/events?apiVersion=2022-11-28 https://docs.github.com/en/rest/activity/events?apiVersion=2... We send these events directly to Trench (the monitoring tool we built). We then use Trench to extract entities (users, comment simhashes, repos, etc.) and other features via a data model we configure through the app (view on desktop only): https://play.trytrench.com/settings https://play.trytrench.com/settings Everything happens in real time—we are able to label spam within milliseconds of receiving the event. Note that the public GitHub event stream is usually around 5m behind real time. We built this because there’s been spam on GitHub lately (see https://djanes.xyz/spam-on-github-is-getting-crazy-these-days https://djanes.xyz/spam-on-github-is-getting-crazy-these-day...) and we wanted to see if we can catch it. Blog with more details: https://www.trytrench.com/blog/preventing-spam-and-fake-stars-github https://www.trytrench.com/blog/preventing-spam-and-fake-star...