3 ms·
Offtopic: What are some good frameworks for webscraping and PDF document processing -- some public and some behind login, some requiring multiple clicks before
by albert_e 2y ago
Offtopic:
What are some good frameworks for webscraping and PDF document processing -- some public and some behind login, some requiring multiple clicks before the sites display relevant data.
We need to ingest a wide variety of data sources for one solution. Very few of those sources supply data as API / json.
- deleted 2y ago[deleted]
- riiii 2y agoI like Crawlee: https://crawlee.dev/ https://crawlee.dev/
- kordlessagain 2y agoI have built most of this and have it running on Google Cloud as a service. The framework I built is Open Source. Let me know if you want to discuss: https://mitta.ai https://mitta.ai