4 ms·

I feel like maybe this problem was "solution first". A cronjob is a solution. For example, Supabase supports cronjobs, but it can't be used to take screenshots.

I feel like maybe this problem was "solution first". A cronjob is a solution. For example, Supabase supports cronjobs, but it can't be used to take screenshots. This might be a non-answer, but if you just want "scheduled notifications of a website change", then you can use something completely purpose built for that. There is a Github action that does exactly this: https://github.com/yasoob/github-action-scraper-tutorial/blob/main/.github/workflows/scrape.yml https://github.com/yasoob/github-action-scraper-tutorial/blo... This might also be a non-answer, but I've found myself using Integromat/Make or Zapier more and more for this type of work. It allows me to whip things up quickly and it can actually be approachable by non-technical people.

mikercampbell 4y ago
As a supabase enthusiast I take this as a direct challenge.
- james2doyle 4y ago
  I like it too and I think you might be able to accomplish this with that extension that allows HTTP requests in your postgres statements but I haven't looked into it
  - mikercampbell 4y ago
    Haha I actually tinkered with it a bit. One thing I love about supabase is that they are focused. They have a ton of features, but they're cohesive in ways no one else has managed. You can manage your document storage, their built-in auth provider, and websocket updates ALL IN SQL. And now their QETL and remote servers?? (https://supabase.com/blog/postgres-foreign-data-wrappers-rust https://supabase.com/blog/postgres-foreign-data-wrappers-rus...) And their CDN and Image processing??? It is shocking and almost painful how beautiful this all is. And how with those basics, you could almost do anything. But yeah, I think the only thing between Supabase and Web Scraping Screenshots is a Postgres Plugin, entirely independent of what Supabase provides. If I were one of those beautiful people who write a blog about rasterizing on a e-pregnancy tests, I'd give it a shot haha
midasz 4y ago
You've also got changedetection.io ->(https://lemonade.changedetection.io/start https://lemonade.changedetection.io/start), which can be selfhosted on a pi etc. I've used it myself to snipe the cheapest kimsufi server.

mikercampbell 4y ago

As a supabase enthusiast I take this as a direct challenge.

james2doyle 4y ago
I like it too and I think you might be able to accomplish this with that extension that allows HTTP requests in your postgres statements but I haven't looked into it
- mikercampbell 4y ago
  Haha I actually tinkered with it a bit. One thing I love about supabase is that they are focused. They have a ton of features, but they're cohesive in ways no one else has managed. You can manage your document storage, their built-in auth provider, and websocket updates ALL IN SQL. And now their QETL and remote servers?? (https://supabase.com/blog/postgres-foreign-data-wrappers-rust https://supabase.com/blog/postgres-foreign-data-wrappers-rus...) And their CDN and Image processing??? It is shocking and almost painful how beautiful this all is. And how with those basics, you could almost do anything. But yeah, I think the only thing between Supabase and Web Scraping Screenshots is a Postgres Plugin, entirely independent of what Supabase provides. If I were one of those beautiful people who write a blog about rasterizing on a e-pregnancy tests, I'd give it a shot haha

midasz 4y ago

You've also got changedetection.io ->(https://lemonade.changedetection.io/start https://lemonade.changedetection.io/start), which can be selfhosted on a pi etc. I've used it myself to snipe the cheapest kimsufi server.