lhoestq

3 ms·

1. 1.▲
   Hugging Face released their storage deduplication ratio and it's huge(old.reddit.com)

   3 points by lhoestq 3mo ago|0 comments
2. 2.▲
   Storage: How to deduplicate at intra and inter-files level(old.reddit.com)

   2 points by lhoestq 3mo ago|0 comments
3. 3.▲
   by lhoestq 7mo ago

   Clickhouse should implement Parquet CDC to enable deduplication and faster uploads/downloads on HF
4. 4.▲
   Hugging Face Storage Buckets(huggingface.co)

   2 points by lhoestq 7mo ago|0 comments
5. 5.▲
   Dataset streaming for distributed SOTA model training now more efficient(huggingface.co)

   2 points by lhoestq 1y ago|0 comments
6. 6.▲
   Dedupe Parquet files for faster I/O(huggingface.co)

   2 points by lhoestq 1y ago|0 comments
7. 7.▲
   by lhoestq 3y ago

   the dataset of tech companies news and blog posts is free and open access on hugging face
8. 8.▲
   A prompt is worth 1000 data points: combining GPT3 prompting and fine-tuning(huggingface.co)

   3 points by lhoestq 6y ago|0 comments
9. 9.▲
   Datasets: Release 1.3 brings dataset versioning, on-the-fly transforms and more(reddit.com)

   2 points by lhoestq 6y ago|0 comments