catskindleyou

3 ms·

1. 1.▲
   by catskindleyou 2y ago

   The spider-rs GitHub project has concurrent chunking of AI while trimming the context of unwanted things html elements, css, and etc. You should check out the project. https://github.com/spider-rs
2. 2.▲
   by catskindleyou 2y ago

   AI tools need to get the data in the proper formats while not letting the data layer being a bottleneck.
3. 3.▲
   by catskindleyou 2y ago

   The chrome speed is also holding the bar high processing thousands of pages per second.
4. 4.▲
   Web Crawler and Scraper for AI(spider.cloud)

   8 points by catskindleyou 2y ago|4 comments