3 ms·
I second this. You've done a great service to collect this data. I'm guessing the file must be much smaller than 20GB when compressed.
by xnx 3y ago
I second this. You've done a great service to collect this data. I'm guessing the file must be much smaller than 20GB when compressed.
- zX41ZdbW 3y agoIt is only around 5 GB in ClickHouse. Details: https://github.com/ClickHouse/ClickHouse/issues/29693 https://github.com/ClickHouse/ClickHouse/issues/29693
- zX41ZdbW 3y agoI've also did an experiment by generating and searching embeddings for all the comments on HN. Here is the walkthrough: https://www.youtube.com/watch?v=hGRNcftpqAk https://www.youtube.com/watch?v=hGRNcftpqAk