MrPowers

25 ms·

211.
by MrPowers 6y ago
Joseph Stiglitz did wonderful research on calculating the staggering financial cost of the Iraq war, estimated at 3 trillion dollars in 2008: https://www.npr.org/templates/story/story.php?storyId=878012... Amazon&
212.
by MrPowers 6y ago
There are lots of different cultures and culture codes tend to emphasize the notion of "having a single culture". I am from New York and spend most of my time in Colombia. My English speaking New York personality and Spanish spea
213.
by MrPowers 6y ago
My open source projects have given me the opportunity to collaborate with highly motivated and smart people. They've made me well-known in my niche and have brought me great job opportunities. They depend on relatively stable APIs an
214.
by MrPowers 6y ago
SBT's deeper problems are the 4-dimensional data model and the 3-layer meta-interpretation model. Probably not the best option for really complicated builds, but it's great for simple builds and I appreciate the tireless open sou
215.
by MrPowers 6y ago
Yep, hype has peaked. Here's a great article on The Death of Hype: What's Next for Scala: https://www.lihaoyi.com/post/TheDeathofHypeWhatsNextforScala...
216.
by MrPowers 6y ago
There have been some great improvements in Scala tooling in recent years. Li Haoyi talks about all these new tools in the Hands-On Scala programming book. Some specific responses: * tooling for writing VSCode: the metals project is great:
217.
by MrPowers 6y ago
The US government wrote the Section 482 tax regulations. Corporations followed the regulations the government wrote. The government provided tons of examples on how taxpayers could follow their rules in the tax guidelines. I've spend
218.
by MrPowers 6y ago
Yes, and the deadweight loss of taxation. Taxing income is economically inefficient (because huge resource investments are needed for compliance). It's more efficient to tax land, gas, and soda. See Pigovian taxation for more details
219.
by MrPowers 6y ago
Thanks for making the post. Focusing on creating a clear thesis at the start of your blog will help your readers understand the purpose of your post. The first paragraph communicates you've struggled with writing in the past, the seco
220.
by MrPowers 6y ago
The spark.sql("""select ... from some_name ...""") bit is how to write pure SQL from the Scala or Python execution context. If you're in the SQL execution context, this syntax isn't required. I neve
221.
by MrPowers 6y ago
I'd argue Koalas is an anti-pattern but will have to justify that in a blog post ;) I've written some popular Scala Spark ( https://github.com/MrPowers/spark-daria ) and PySpark ( https://github.com&#
222.
by MrPowers 6y ago
Same for me. Python and Scala let users break up the logic into DataFrame transformations that can be unit tested, packaged into Wheel / JAR files, and easily reused in multiple contexts. Maintaining big, complex SQL codebases isn&#x
223.
by MrPowers 6y ago
Here's the Scala Spark style guide: https://github.com/MrPowers/spark-style-guide The chispa README also provides a lot of useful info on how to properly write PySpark code: https://github.com/MrPo
224.
by MrPowers 6y ago
Dask is a great alternative for distributed computing as well: https://github.com/dask/dask IMO, Spark is better for some tasks and Dask is better for others.
225.
by MrPowers 6y ago
Snowflake seems like a unique product and I can only imagine the complex math they're doing under the hood to achieve these incredible query times. memsql is the only real competitor I know of. Redshift is a lot less user friendly (c
226.
by MrPowers 6y ago
I did a Google search and found multiple sources that support "The federal government fully guarantees almost all student loans." One example: https://www.investopedia.com/articles/personal-finance/08121
227.
by MrPowers 6y ago
They're my blog posts and that's a good point. I can generally write a blog post in a few hours. Martin's book is clearly a masterpiece and mine isn't. Just though I'd chime in and let folks know that writing a bo
228.
by MrPowers 6y ago
I wrote two books this year, Beautiful Spark being the more popular of the two: https://leanpub.com/beautiful-spark My book writing experience was much different: * just took a few weeks of part time work, mainly just organ
229.
by MrPowers 6y ago
Both private institutions and the government are student loan lenders in the US. The government also guarantees a lot of private loans. It's good to clarify which lenders you're referring to when you say "Education lenders a
230.
by MrPowers 6y ago
Even Terence Tao needed 4 years to get his PhD: https://en.wikipedia.org/wiki/Terence_Tao I don't know any three year examples. I'm sure there are PhD degree mill spots that'll give you the degree in a
231.
by MrPowers 6y ago
This is a great point, thanks for commenting. Still thing my main point stands, but more because capital gains taxes can be deferred. It's amazing how convoluted / confusing dividend taxation is.
232.
by MrPowers 6y ago
This section of the article is great: > Over time, share repurchases became a substitute for dividends. Managers rationalized the practice by saying they were doing shareholders a favor: Dividends were taxed as ordinary income, whereas
233.
by MrPowers 6y ago
Emacs keybindings like Control-x Control-c don't work for me on regular keyboards. They work just fine for me on ortho keyboards with an easily accessible control key for my right thumb. Ortho keyboards got me in the habit on using mo
234.
by MrPowers 6y ago
I've loved learning how to use ortho keyboards. They open your brain to new text editing possibilities. Just like how learning Spanish teaches you about English and learning new programming languages teaches you about what's pos
235.
by MrPowers 6y ago
I use a Kinesis Advantage and it's great (not quite split, but close). I'll look into getting an actual split keyboard that's more portable. The Kinesis is massive and terrible for travel. You can easily switch between Kine
236.
by MrPowers 6y ago
According to The World Bank Data, South Africa has the highest Gini in the world: https://data.worldbank.org/indicator/SI.POV.GINI?most_recent... Brazil is up there. Some of the data is old, let me know if you have a
237.
by MrPowers 6y ago
It links to this article with a graph showing that Brazil and South Africa have some of the worst income mobility in the world: https://www.businessinsider.com/countries-where-intergenerat... I live in Colombia and was in B
238.
by MrPowers 6y ago
Analyzing some statements from the article: * "It's easier to achieve the American Dream in China, South Africa, and Brazil than it is in the US." South Africa and Brazil are two of the most unequal countries in the world as
239.
by MrPowers 6y ago
This section presupposes that you inevitably run out of tasks that are high-impact and easy, which hasn't been what I've observed. There are tons of little code functions that can be tested, released via open source / intern
240.
by MrPowers 6y ago
Great question. My blog is to help people answer questions they Google. I'm the top result for searches like "spark partitionby". The content isn't anything new. They're just useful posts for people that are bus

More ›