4 ms·
Has anyone hosted this somewhere yet? I was hoping I could just run it locally but you have to crawl all those sites every time, and it's not concurrent...
by kenning 10y ago
Has anyone hosted this somewhere yet? I was hoping I could just run it locally but you have to crawl all those sites every time, and it's not concurrent...
- uhryks 10y ago> leveraging Elixir's GenServer and Erlang's BEAM VM. > it's not concurrent (。´･ω･)?
- sergiotapia 10y agoIt's concurrent in that multiple crawlers run at the same time. But I do not concurrently crawl single websites. An initial version had that, and Magnetissimo easily crawled 600 torrents every page 3 seconds (not hyperbole). It just pounded websites and I didn't want that. It was bad karma.
- omnicoder 10y agoI just setup a test site based on it http://v.reni.com:4000/ http://v.reni.com:4000/