4 ms·
> leveraging Elixir's GenServer and Erlang's BEAM VM. > it's not concurrent (。´･ω･)?
by uhryks 10y ago
> leveraging Elixir's GenServer and Erlang's BEAM VM.
> it's not concurrent
(。´･ω･)?
- sergiotapia 10y agoIt's concurrent in that multiple crawlers run at the same time. But I do not concurrently crawl single websites. An initial version had that, and Magnetissimo easily crawled 600 torrents every page 3 seconds (not hyperbole). It just pounded websites and I didn't want that. It was bad karma.