RobinL

24 ms·

361.
by RobinL 4y ago
What do you recommend instead and why?
362.
SQL should be the default choice for data transformation logic(robinlinacre.com)
434 points by RobinL 4y ago|267 comments
363.
by RobinL 4y ago
Given that women on average don't earn that much less than men, it can't be that rare for women to earn more than their male partner
364.
by RobinL 4y ago
I had 9 months off and then went down to three days/week 3 years ago, after the birth of my first child. Definitely happier, the kids love it, and both parents are less tired so we have more quality time. Also it turned out having ki
365.
by RobinL 4y ago
Splink - a FOSS python library for probabilistic record linkage (fuzzy matching/entity resolution). Splink is dramatically faster and works on much larger datasets than other open source libraries. I'm particularly proud of the f
366.
by RobinL 4y ago
It still leaves the problem of people living in much larger houses than they need because it's financially advantageous to do so. Here in the UK older people with kids who've left the nest often continue to live in large houses be
367.
by RobinL 4y ago
In Britain (where I live) it's standard (I believe?) to leave a circa 10% tip at a restaurant. When I've travelled to Europe I've done the same (but haven't thought much about whether it was expected). Restaurants are th
368.
by RobinL 4y ago
For those of us reading this who would like to genuinely and effectively offset emissions, is anyone able to suggest some really robust schemes where you can be confident the offsets are real? I'm especially interested in schemes wher
369.
by RobinL 4y ago
I would generally recommend parquet for the reasons set out here: https://www.robinlinacre.com/parquet_api/
370.
by RobinL 4y ago
If gas remains expensive in Europe, it won't be absurd, so much as an economic no brainer to have a air to air heat pump, alongside a back up gas boiler. This should happen pretty quickly as renewables take off, and gas is no longer n
371.
by RobinL 4y ago
With apologies for my absolutely appalling French, here's a transcript of ChatGPT giving me a French lesson. It's better than any classroom based language teaching I've experienced: https://gist.github.com/Ro
372.
by RobinL 4y ago
See here! https://news.ycombinator.com/item?id=33922390
373.
by RobinL 4y ago
It's quite complicated, but there's a good explanation here: https://news.ycombinator.com/item?id=33922390 (I recently asked the same question!)
374.
The UK is wasting a lot of wind power(archy.deberker.com)
441 points by RobinL 4y ago|390 comments
375.
by RobinL 4y ago
Yes - good point. That touches on another myth I've heard frequently - that heat pumps are only suitable on well insulated homes. I think this may be true in relation to some air-to-water systems (?), but it ignores the possibility of
376.
by RobinL 4y ago
I'm a air-to-air heat pump owner and I love it and think they will be a key part of climate mitigation. However, from a climate change policy perspective, it is important to _emphasise_ that heat pumps are less efficient at lower tempe
377.
by RobinL 4y ago
I am lead author of an active 400+ star repo with 300k downloads a month on pypi, but don't get copilot free. The repo is hosted on my organisation's GitHub, not my personal one. I am also author of an inactive 250+ star repo on
378.
by RobinL 4y ago
That's really good, thanks. Better than my blog, actually - the author has a much deeper understanding and I learned a lot by reading it. I was coming at it from the perspective of someone very confused by Arrow, and wrote the blog to
379.
by RobinL 4y ago
This is also my understanding - see https://news.ycombinator.com/item?id=34324649
380.
by RobinL 4y ago
I'm not an expert in the nuts and bolts of Arrow, but I think you have two options: - Save to feather format. Feather format is essentially the same thing as the Arrow in-memory format. This is uncompressed and so if you have super fas
381.
by RobinL 4y ago
Yes - save to parquet. From the OP: "Why not just persist the data to disk in Arrow format, and thus have a single, cross-language data format that is the same on-disk and in-memory? One of the biggest reasons is that Parquet generally
382.
by RobinL 4y ago
Author here. Since I wrote this, Arrow seems to be be more and more pervasive. As a data engineer, the adoption of Arrow (and parquet) as a data exchange format has so much value. It's amazing how much time me and colleagues have spe
383.
by RobinL 4y ago
An example using R code is here: https://arrow.apache.org/docs/r/articles/dataset.html The speed comes from the raw speed of arrow, but also a 'trick'. If you apply a filter, this is pushed down to
384.
by RobinL 4y ago
Author here! I've actually just written a separate blog post on a similar topic! https://www.robinlinacre.com/parquet_api/ Parquet seems to be on a path to become the de facto standard for storing and sharing bul
385.
Why parquet files are my preferred API for bulk open data(robinlinacre.com)
8 points by RobinL 4y ago|0 comments
386.
by RobinL 4y ago
Native English speaker here: I flubbed the first time I read it - specifically the 'all places wild' bit at the end.
387.
by RobinL 4y ago
Zero facts about his energy usage, and what his bill would have been if he'd stayed on gas at this year's prices. Our £2k air source heat pump has been pretty much cost neutral in terms of bills. This was fully expected: we boug
388.
by RobinL 4y ago
Here's some rough numbers, hopefully i haven't made any mistakes: Total US energy generation 2021: 4 trillion kwh Average power generation: 457Gw Cost of Topaz solar farm: $2.5bn Potential output: 550 Mw Cost per Mw $4.5m Spend a
389.
by RobinL 4y ago
thanks - very interesting! I think that also clarifies something I'd found confusing: that the spot price is currently effectively determined by the price of gas, and yet the UK consumer is benefitting from the presence of wind genera
390.
by RobinL 4y ago
I've always wondered under the mechanism who has benefited from higher energy prices in the UK? With consumers currently paying high prices, who's getting the difference between the CfD price and the market price for energy gener

More ›