iknownothow

15 ms·

121.
by iknownothow 4y ago
Yes it has. I order groceries from my couch and I pay 2€ extra for delivery and my door bell rings under 15 minutes 95% of the times, sometimes in under 7 minutes. I live in a major German city. P.S. I have at least twice ordered missing in
122.
by iknownothow 4y ago
I knew my bet to sticking with Postgres would pay off! This looks super exciting. I thought of doing something similar for our data warehouse with AWS Fargate and Postgres but the cold starts and limited disk space required too much enginee
123.
by iknownothow 4y ago
In that case I would be curious if these differences show themselves in people from different cultures that consume Turmeric en masse. For example, my aging parents consume significant amounts of turmeric (approx. 250 mg) for 2 out of 3 mea
124.
by iknownothow 4y ago
I don't exactly know what Pycharm does but I only add type hints when Pycharm's default type checker raises a complaint or is unable to infer the type. To me that's just the perfect middle ground. Sometimes adding a type to a
125.
by iknownothow 4y ago
Sources for claims? Genuinely curious.
126.
by iknownothow 4y ago
Sure, I agree that it's incorrect. I should have used 0K as base.
127.
by iknownothow 4y ago
For some reason you seem to have ignored the second half of the sentence I wrote. > Sure that's only a 6.5% increase in temperature w.r.t. to 46C ... but that's an incorrect way of looking at it. I've added an edit to clar
128.
by iknownothow 4y ago
for anyone who thinks 49C in Delhi is some extreme temperature it's not really that far from usual maximum (2019 and 2020 both May max. 46C). That's a 3C increase! Sure that's only a 6.5% increase in temperature w.r.t
129.
by iknownothow 4y ago
As far I can tell, exporting query results from Postgres RDS to S3 uses Postgres's Copy and only supports CSV and Text [1]. Can you provide a link for parquet exports? [1] https://docs.aws.amazon.com/AmazonRDS/late
130.
by iknownothow 4y ago
The underlying causes of the problem are both mathematical and human. While the mathematical causes are reasonably well understood by experts, I think the book Sapiens covers the human factors quite well. A tidbit from the book is that huma
131.
by iknownothow 4y ago
As someone who only knows Python, this gives me existential angst. Like some other people have pointed out, I think the GIL is secret sauce to Python's success. I would be vary of the religious fervor behind taking the GIL to the gall
132.
by iknownothow 4y ago
This pales in comparison to Pydantic in terms elegance, flexibility and batteries being included. But pydantic is quite slow. I discovered pydantic-core [1] which is a backend of sorts for pydantic written in Rust. It is yet to be integrate
133.
by iknownothow 4y ago
After reading a few comments here, here's the experiment I'm going to run this weekend to couple Postgres (AWS rds) and DuckDB There's already an FDW for DuckDB [1]! But it's not available from within AWS RDS because the
134.
by iknownothow 4y ago
I'm not denying the importance of performance and query planning here, but merging two statements into one is what I as a (specific kind of) data engineer care about more. Letting postgres take care of consistency while keeping the SQL
135.
by iknownothow 4y ago
Thanks, that was a fun read. [1] https://en.m.wikipedia.org/wiki/Clathrate_gun_hypothesis
136.
by iknownothow 4y ago
Just a personal anecdote to provide some context of how hot it really is. I'm from the south of India and now live in Europe. My body tolerates heat quite well compared to my European friends. I remember tolerating 38-40C indoor tempe
137.
by iknownothow 4y ago
How do you keep your builds reproducible? I understand that once it's built, a docker image makes that specific build immutable and you can distribute it without worry. However, if you were to run the build stage again i.e. rebuild the
138.
by iknownothow 5y ago
I decided not to introduce DuckDB for my org, 6 team members and <10TB of data solely based on lack of full support for Postgres like JSONB. Currently, we are happy using Postgresql JSONB with a small performance penalty . I would be loa
139.
by iknownothow 5y ago
The example of processing and querying a 1GB "JSON Lines" [1] file, where each line is a json document 0.1-10KB in size with a varying schema on every line is a very common use case in data engineering. On top of that, there are a