3 ms·
The scale. How many tools do you know that can query the content of all arxiv papers.
by 7moritz7 9mo ago
The scale. How many tools do you know that can query the content of all arxiv papers.
- eamag 9mo agoDoesn't look like the scale is there, even for HN: > Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite
- Xyra 9mo agoThe scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.