3 ms·
Not specific to the CPG realm, but I've had some very good luck working with the OpenAPI-devtools Chrome Extension[1] (previous discussion here on hackernews[2]
by JimXugle 3y ago
Not specific to the CPG realm, but I've had some very good luck working with the OpenAPI-devtools Chrome Extension[1] (previous discussion here on hackernews[2]) to discover the underlying APIs of various sites that I want to scrape data from.
[1] https://github.com/AndrewWalsh/openapi-devtools https://github.com/AndrewWalsh/openapi-devtools
[2] https://news.ycombinator.com/item?id=38012032 https://news.ycombinator.com/item?id=38012032
- NickFanion 3y agoThis is a huge help, thank you. I've been using the Postman Interceptor extension, but OpenAPI-devtools looks tailor made for my use case. The hard part will still be figuring out the auth headers/calls (EDIT: the dev has added auth support since the HN post!)