4 ms·
Hello there! I've been building a Reddit scrapper, to analyze the connections between subreddits (subreddits are the nodes, and the users who posted or commente
by jakabia 4y ago
Hello there! I've been building a Reddit scrapper, to analyze the connections between subreddits (subreddits are the nodes, and the users who posted or commented in the same subreddits, are the links). My future plan is to build an API for it, so others can use the data for their research or side projects. It's not done yet, but almost - the data will be stored on Firestore. I have plans on how to scale it up - currently it's 5-10 seconds / user, and given the Reddit's large user base, it's an issue which needs to be handled. For the API, I'd add tiered pricing as well, because storing, writing and reading data is a cost.
So, what do you think about it?
Also, I've been a solo programmer my whole life, because basically all of my programmer friends are like "why code after 5pm?". They just do their 9-5 jobs and that's all, they're satisfied. Which is okay! Just for someone like me, who loves to code, build stuff and discover new technologies, it's sad, because I can't partner up with others to build more complex stuff and to exploit our full potential.
About me: currently I'm a mid-level frontend dev, and I'm trying to move from frontend to backend/devops/cloud, not sure exactly where, but definitely away from frontend.
So if you'd like to have a programmer buddy to discuss tech-related stuff, or to build fun things together, feel free to reach me out, I love programming and I want to level up and I think it's almost impossible alone.