4 ms·
Curious how this scales. Just tried this with the test dataset and it was probably the slickest deduplication experience I’ve had
by OliverGilan 2y ago
Curious how this scales. Just tried this with the test dataset and it was probably the slickest deduplication experience I’ve had
- remolacha 2y agoAppreciate the kind words! Linear scaling in terms of speed and cost. We haven't yet optimized the prompts & choice of model to minimize token usage, so I'd recommend emailing us for advice if you want to run this on a large dataset