3 ms·
I wonder how much time it takes to run this / what the script is / how resource intensive it is? Bsky is public right, so do you get rate limited? Do you scrape
by yawnxyz 2y ago
I wonder how much time it takes to run this / what the script is / how resource intensive it is? Bsky is public right, so do you get rate limited? Do you scrape or use an official API? So many questions
Also, I feel like only recently there's been an influx of people who have actually interesting things to say so I'd love to see nextyear's dataset
- viccis 2y agoNot sure about bulk export but you can set up a full stream of all activity without even registering an account.
- unshavedyak 2y agoBlows my mind that they can send that much for free.
- ks2048 2y agoI was checking out the Python API today (the "firehouse" via "atproto" package) and got 5000 posts in 7.5 seconds.
- verdverm 2y agoI believe they are enabling(ed?) filters so you can control how much and what you actually get from the firehose