3 ms·
Show HN: Real-Time Bluesky Post Firehose in < 256MB
Hello everyone, I'm still trying to get some traction with sqlflow!
I'm completely disenchanted with the modern data stack, and am trying to create a toolchain that helps treat data as if it were software: Observability, Integrated Testing, Performance and a real UX.
The linked page uses sqlflow (the foundation of this datastack) to consume and window the bluesky post firehose, save it to postgres, then serve it back over HTTP for dashboarding.
What're you using for analytics? Do you serve lines a chart to your customers? What tech are you using? Are you happy with the JVM (flink)?
i'm very interested in learning how you tackle streaming data and analytics today! Thank you
- verdverm 16d agoAre you aware you have posted a valid `Authorization: Bearer ...` key on your landing page?
- dm03514 16d agoyes! And I appreciate you calling it out, I'll choose a different name for it. It's just a token like posthog or google analytics issues customer-facing tokens. You are welcome to hit the API directly using it. What is this type of token called (one that identifies a JS client)?
- verdverm 16d agoan `id`? It's sloppy to use an auth header for a dataset index, just make it a query param, because it definitely seems like a parameter for the query
- dm03514 15d agoThank you, fixed: https://github.com/turbolytics/sql-flow/commit/e7cc28b7bdd2f6b07810b7ea650424d0d7057520 https://github.com/turbolytics/sql-flow/commit/e7cc28b7bdd2f... docs are updated: https://turbolytics.io/demos/bluesky https://turbolytics.io/demos/bluesky
- verdverm 15d agoI'm not your target user, I've left Bluesky and ATProto permanently