3 ms·
Scribe[1], Scuba[2], Hive[3], and folly[4]. It's neat for sure, but speaking as an outsider without the resources to learn (much less create!) an entire univers
by smitelli 2y ago
Scribe[1], Scuba[2], Hive[3], and folly[4]. It's neat for sure, but speaking as an outsider without the resources to learn (much less create!) an entire universe of data infrastructure and SDKs, it feels like I'm in the corner eating dinner at the kids' table.
At any rate, I'm glad somebody out there is doing this stuff.
[1]: https://engineering.fb.com/2019/10/07/core-infra/scribe/ https://engineering.fb.com/2019/10/07/core-infra/scribe/
[2]: https://research.facebook.com/publications/scuba-diving-into-data-at-facebook/ https://research.facebook.com/publications/scuba-diving-into...
[3]: https://research.facebook.com/publications/hive-a-warehousing-solution-over-a-map-reduce-framework/ https://research.facebook.com/publications/hive-a-warehousin...
[4]: https://github.com/facebook/folly/tree/main https://github.com/facebook/folly/tree/main
- deleted 2y ago[deleted]
- paxys 2y agoYou can absolutely learn it. Elasticsearch, Logstash, Kibana, Grafana, Prometheus. Set up a local Docker Compose deployment of the full stack and pass through some dummy events. Write an app to generate synthetic load. Play around with aggregations and visualizations. Tech blogs use a lot of buzzwords but you just need to know the fundamental concepts.