4 ms·

Users do not get pinged when you @them on this website. You can email and they will respond. There's a link bottom right.

therein 2y ago
Will do, thanks. I found the source of the issue in the meantime. I had set up an ArchiveBox instance and it seems it full on went recursive on an HN link I gave it to test it even though I told it to go only 1 level deep.
- nikisweeting 2y ago
  Woah that's very strange because it doesn't even have code to support anything beyond depth=1! Perhaps there were more hidden links in the html than are visible to humans? It uses a simple regex filter to find URLs so it's not smart about telling the difference between a link in some embedded JSON and real <a href>.
  - therein 2y ago
    Yeah it is quite surprising in hindsight. I saw a GH issue where they talk about how crawling is not a feature they want to support etc. but it went recursive on users somehow. Your explanation sounds plausible.
    - nikisweeting 2y ago
      Well I should've mentioned I am the ArchiveBox creator haha. I'm curious because it would save me a lot of work implementing this feature if it's already working somehow!
      - therein 2y ago
        That's quite the coincidence. :) Either way, I appreciate your open source work. ArchiveBox is definitely useful and has become a part of my workflow. Something that can incorporate TrueNAS, ArchiveBox, Plex and RunDeck features in a single UI would be quite interesting.
        nikisweeting 2y ago
        Thanks for the kind words. I've experimented with RunDeck, N8N/NodeRED, and Ansible's AWX and found it hard to choose between them as they were each good at certain niches. I think the best option there is to give users the flexibility of choosing an automation layer themselves. Hopefully our new REST API and outbound webhooks support makes it easier to integrate with whatever solutions pop up in that space in the future: https://github.com/ArchiveBox/ArchiveBox/releases/tag/v0.8.0-rc https://github.com/ArchiveBox/ArchiveBox/releases/tag/v0.8.0... BTW we also just released a new official TrueCharts chart for TrueNAS recently and need help testing it: https://truecharts.org/charts/stable/archivebox/ https://truecharts.org/charts/stable/archivebox/

therein 2y ago

Will do, thanks. I found the source of the issue in the meantime. I had set up an ArchiveBox instance and it seems it full on went recursive on an HN link I gave it to test it even though I told it to go only 1 level deep.

nikisweeting 2y ago
Woah that's very strange because it doesn't even have code to support anything beyond depth=1! Perhaps there were more hidden links in the html than are visible to humans? It uses a simple regex filter to find URLs so it's not smart about telling the difference between a link in some embedded JSON and real <a href>.
- therein 2y ago
  Yeah it is quite surprising in hindsight. I saw a GH issue where they talk about how crawling is not a feature they want to support etc. but it went recursive on users somehow. Your explanation sounds plausible.
  - nikisweeting 2y ago
    Well I should've mentioned I am the ArchiveBox creator haha. I'm curious because it would save me a lot of work implementing this feature if it's already working somehow!
    - therein 2y ago
      That's quite the coincidence. :) Either way, I appreciate your open source work. ArchiveBox is definitely useful and has become a part of my workflow. Something that can incorporate TrueNAS, ArchiveBox, Plex and RunDeck features in a single UI would be quite interesting.
      - nikisweeting 2y ago
        Thanks for the kind words. I've experimented with RunDeck, N8N/NodeRED, and Ansible's AWX and found it hard to choose between them as they were each good at certain niches. I think the best option there is to give users the flexibility of choosing an automation layer themselves. Hopefully our new REST API and outbound webhooks support makes it easier to integrate with whatever solutions pop up in that space in the future: https://github.com/ArchiveBox/ArchiveBox/releases/tag/v0.8.0-rc https://github.com/ArchiveBox/ArchiveBox/releases/tag/v0.8.0... BTW we also just released a new official TrueCharts chart for TrueNAS recently and need help testing it: https://truecharts.org/charts/stable/archivebox/ https://truecharts.org/charts/stable/archivebox/