peterdstallion

2 ms·

1. 1.▲
   by peterdstallion 1y ago

   I am a paying subscriber to Gemini, Claude and OpenAI. I don't know if it's me, but over the last few weeks I've got to the conclusion ChatGPT is very strongly leading the race. Every answer it gives me is better - it's
2. 2.▲
   DuckDB can be 5x faster than Spark at 500M record files(blog.dataexpert.io)

   4 points by peterdstallion 1y ago|1 comments
3. 3.▲
   by peterdstallion 1y ago

   This test was done on a small dev laptop with 16GB of RAM, scanning a 500M row (record) 23GB Parquet file. DuckDB proved to be 5x faster. A bit of an obvious one - small data tech is faster at small data. It serves more of a lower bound rem
4. 4.▲
   by peterdstallion 1y ago

   The technological progress is astonishing. But so is the societal degradation that came with it.
5. 5.▲
   by peterdstallion 1y ago

   It's my go-to keyboard. I can't recommend it enough. My only regret is I didn't buy it earlier. It's definitely way more ergonomic - I believe that's incredibly important if you're going to be spending decades
6. 6.▲
   A New Wave: From Big Data to Small Data(fabi.ai)

   2 points by peterdstallion 1y ago|0 comments
7. 7.▲
   by peterdstallion 2y ago

   Nope, they seem to have their own catalog library that translates it: https://github.com/awslabs/s3-tables-catalog