MrPowers

31 ms·

271.
by MrPowers 6y ago
The title of the article says "U.S. Economy Contracts at Record 32.9% Annual Rate". A HN mod should change the title here on this site cause it's misleading.
272.
by MrPowers 6y ago
This is an overly simplistic view in my opinion. #1 assumes a strong relationship between the stock market and the overall economy which hasn't been true in recent years (corporate profits are growing way faster than the economy). #2
273.
by MrPowers 6y ago
The fair value of a stock is the discounted net present value of future profits of an enterprise, plus assets, minus liabilities. There are a lot of companies that continue to make a lot of money and the market is confident in the long ter
274.
by MrPowers 6y ago
There is a project called vega that's a Spark implementation in Rust: https://github.com/rajasekarv/vega . It looks promising. Databricks rewrote the Spark engine in C++ (called the Delta Engine, see here: https:&
275.
by MrPowers 6y ago
Arrow is tightly integrated in Spark's Scala code: https://github.com/apache/spark/search?q=arrow&unscoped_q=ar... Andy Grove is building a "distributed compute platform implemented in Rust, using th
276.
by MrPowers 6y ago
Great article. Cutting ec2 costs is important, especially for companies with heavy data engineering / data science workflows. Spark service providers make it easy to spin up huge clusters (100+ nodes) to perform ad hoc analyses. The
277.
by MrPowers 6y ago
When you searched Airbnb for prices they wouldn't include cleaning or additional services. For my first few years using Airbnb, this wasn't a problem, but then folks began hacking the search algorithm and charging huge cleaning f
278.
by MrPowers 6y ago
Koalas is the Pandas API on top of Apache Spark for anyone that's interested: https://github.com/databricks/koalas It works similar to PySpark and is scalable to massive datasets (hundreds of terabytes). Koalas i
279.
by MrPowers 6y ago
Most of the other suggestions wouldn't work for me personally. Reworking old documents is too boring. Reading The Elements of Style isn't going to happen. Focus on writing stuff you like to write about. I like writing about Apac
280.
by MrPowers 6y ago
Buying books from fnac.com sounds like a bad experience. I've bought books from https://leanpub.com/ without any problems.
281.
by MrPowers 6y ago
Newer versions of Pandas don't even need fastparquet anymore. This code works: import pandas as pd df = pd.read_csv('data/us_presidents.csv') df.to_parquet('tmp/us_presidents.parquet')
282.
by MrPowers 6y ago
This article explains how to convert CSVs to Parquet with Pandas, PySpark, and Koalas: https://mungingdata.com/python/writing-parquet-pandas-pyspar... This article explains how to convert CSVs to Parquet with Go and Sc
283.
by MrPowers 7y ago
I'd suggest starting with the Kinesis and then trying Emacs. I tried Emacs multiple times on "regular" keyboards and it never made sense to me. It wasn't till I tried it with the Kinesis keyboard that I was able to fal
284.
by MrPowers 7y ago
I am always surprised when software engineers have such strong opinions on monetary policy. Black and white statements like "There is nothing the Fed can do revive the economy from the Corona virus" aren't the best for macro
285.
by MrPowers 7y ago
Congrats! Did O'Reilly give you valuable technical feedback while you were writing the book? I was in talks with publishers, but decided to self-publish ( https://leanpub.com/beautiful-spark/ ) because I didn&#x27
286.
by MrPowers 7y ago
assets + liabilities = book_value_of_equity The intrinsic value of a company's equity often differs from the book value of equity. The book value debt can also differ from the market value. Learning some financial accounting concepts s
287.
by MrPowers 7y ago
This isn't "my formula" - it's the textbook finance formula: https://en.wikipedia.org/wiki/Enterprise_value
288.
by MrPowers 7y ago
Market cap is the market value of a company's equity. market_cap = total_shares_outstanding * share_price I passed all three CFA exams a few years back and studied this extensively. I might be remembering incorrectly, but think you&#x
289.
by MrPowers 7y ago
The enterprise value is the value of a company. enterprise_value = market_cap + debt - cash Different companies are capitalized differently - some use all equity, some all debt, some a mix. Not sure I agree that other claim holders represen
290.
by MrPowers 7y ago
GitHub issues / pull requests / projects / wikis... the standard tools GitHub offers to manage projects.
291.
by MrPowers 7y ago
This has been my observation as well - projects flourish under the Apache umbrella. Parquet and Arrow are also widely used and will probably continue gaining importance. A Rust big data engine, similar to Apache Spark, was just donated to
292.
by MrPowers 8y ago
They tried to keep it closed and sell it as a premium service, but looks like they need help from the open source community to make the product better. Great to see. Databricks has its roots in open source (the founder created Spark) and
293.
by MrPowers 8y ago
There are different types of index funds. There are market capitalization weighted index funds that fit your description of buying the entire market, but there are also small cap funds, sector funds, value funds, etc. You can avoid certai
294.
by MrPowers 8y ago
Nope, he is a "Front-end web consultant and coach": https://tinnedfruit.com/
295.
by MrPowers 8y ago
Notebooks are great for invoking existing functions and exploring data. Notebooks aren't ideal for creating functions (standard text editor features are lacking and testing is impossible). Notebooks encourage an "order dependent v
296.
by MrPowers 8y ago
I am a Spark data engineer and spend a lot of time in Scala / Python IDEs & browser notebooks. Databricks lets you package code as JAR / wheel files & attach the binaries to the cluster. I write all the complicated code
297.
by MrPowers 8y ago
This article makes it sound like Spark needs to be run on Hadoop clusters and that's not the case. Spark can be run on object stores like AWS S3 and Azure. I also don't agree with the author's assertion that Spark is "S
298.
by MrPowers 8y ago
I'm sure this is effective, but are folks really willing to agree to this? Do you pay for the 2 weeks of work? Do candidates ever say no to this arrangement?
299.
by MrPowers 8y ago
I have a popular Apache Spark blog on Medium ( https://medium.com/@mrpowers ). Spark is a niche technology and there isn't a lot of competition. I rank #1 on Google searches for common searches like "spark null&quo
300.
by MrPowers 8y ago
Yep, agreed, especially with current market conditions (high asset prices and low bond yields). Research Affiliates has an awesome tool that shows expected returns by asset class ( https://interactive.researchaffiliates.com/

More ›