snidane

28 ms·

241.
by snidane 6y ago
In Databricks you only get cloud storage (s3) as a persistent storage for data. So the data has to move from s3 to compute nodes. Self hosted HDFS will work more like shared nothing.
242.
by snidane 6y ago
https://github.com/delta/delta-oss link seems to be broken.
243.
by snidane 6y ago
Teradata is shared-nothing architecture. Of course it will outperform Databricks and Snowflake shared-disk model as the data is colocated on the compute nodes so it doesn't have to travel anywhere. Good luck on your budget trying to sc
244.
by snidane 6y ago
While both BQ and Snowflake are adopting lake features, they still only support parquet and other file formats for loading, not for querying. Can't do a simple select * from s3://file.parquet which you can do in Spar
245.
by snidane 6y ago
Snowflake and Bigquery will bite you in the ass later on. You can do 80% of the things you will need - which is great for some newbie stuff or for sales presentations. Once you need something complicated, you're on your own, while bein
246.
by snidane 6y ago
It seems that the flash mob just needs to achieve critical mass and then momentum traders and sentiment driven algos will pick up on the sudden trend and bubble it up out of proportions.
247.
by snidane 6y ago
> capital returns != interest rates What makes the difference? That one comes from stocks and the other from bonds and loans? Or the amount of risk associated with it? I don't think there is a difference for an investor who just pic
248.
by snidane 6y ago
Module corresponds to a class, not to an object. Afaik, you can't instantiate a module in python multiple times with different parameters. In theory you would like to do this, but it is not supported in python, therefore you would use
249.
by snidane 6y ago
> So called "best practices" are contextual and not broadly applicable. Blindly following them makes you an idiot. Very true. "Best practice" are most often just "common practices" - how we've done thin
250.
by snidane 6y ago
Funny when you look at the actual definition of a project straight from PMP. "a temporary endeavor undertaken to create a unique project service or result." No "projects" in software fhat I know of are actually temporary
251.
by snidane 6y ago
When a company uses software estimation, it suggests strong distrust towards the software people and is looking for justification of those huge costs. Most often it means some shitshow happened or is still going on in there.
252.
by snidane 6y ago
Software development which is a repeatable and already defined process is totally possible to predict and estimate. Most tasks of repeatable processes follow normal distribution and is predictable. Deviations from expected mean will be due
253.
by snidane 6y ago
Stonebraker often amusingly describes the NoSQL meaning changing over time as adopters come to realization that SQL is not going away. - NoSQL as No SQL at all - NoSQL as Not Only SQL - NoSQL as Not Yet SQL
254.
by snidane 6y ago
In data engineering your goal is "standardization". You can't afford every team using their unique tech stack, their own databases, coding styles, etc. People leave the company all the time and you as a data engineer always e
255.
by snidane 6y ago
Coincidentally I was just watching these Yale lectures which touch on economical history of unions in the 20th century. Might be of interest to HN readers. https://youtu.be/q53DF6ySOZg - The Resurgent Right in the West htt
256.
by snidane 6y ago
I have always wondered why functions have to be declared inline when it is more up to the caller to declare whether to inline the contents of the function at call site. So instead of inline int f(int x) { return x * x; } int main() {
257.
by snidane 6y ago
Mining Massive DataSets (MMDS) from Stanford professors. Videos: https://www.youtube.com/playlist?list=PLLssT5z_DsK9JDLcT8T62... Book: http://www.mmds.org/
258.
by snidane 6y ago
> Housing is literally exclusively a supply and demand problem. If you want rent to go down, allow more building Wrong. Without Land Value Tax the housing market simply doesn't clear. If there is no force to make house and land owne
259.
by snidane 6y ago
Nothing can beat whiteboarding on shower glass properly fogged up after 30 mins in the shower.
260.
by snidane 6y ago
Housing prices increasing because of slow zoning and regulations has been debunked already. Typical argument used by property developers. The reality is that building houses for investment is more profitable for developers so they keep buil
261.
by snidane 6y ago
And as any large software project eventually collapses on its own weight of complexity, so do societies when their tax and law codes become too complicated for citizens to comprehend and only clerks, priests and lawyers can be hired to help
262.
by snidane 6y ago
State management systems are what OOP is used. It used to be GUIs until React, Elm and such proved that FP style describing the end state is a better fit. "Simulations" can be done in both real time state management OOP style or F
263.
by snidane 6y ago
1. Framework owns your main() function. Using libraries you don't lose control of your main(). 2. Hollywood principle. Library: you call us. Framework: we call you. 3. Frameworks are good for novices in certain paradigm because they gu
264.
by snidane 6y ago
I honestly don't understand your point much. But let me add this about speculation and land holding for the next user. There is zero need for a private owner to hold it. The land will not disappear, it will always be there. Government
265.
by snidane 6y ago
Yes there are landlords who hold land out of use because they know there are or will be others who will eventually want to use it. There is very clear profit in buying land for cheap and sitting on it until somebody wants it. Land doesn&#x2
266.
by snidane 6y ago
Wrong. The "productive" activity for land holders under system without LVT is preventing others from utilizing it. Without LVT you only achieve massive resource underutilization and favoritism of the first who grabbed it.
267.
by snidane 6y ago
If there ever is a universal economic constant then it is precisely the fact that rent always catches up to what people are making in that city.
268.
by snidane 6y ago
Hmm, I thought quantum computing is not happening. See https://scottlocklin.wordpress.com/2019/01/15/quantum-comput... Can somebody dispute this claim?
269.
by snidane 6y ago
Or consider the alternative scenario where population keeps declining but technological advancement doesn't materialize. Which for AI and machine learning could happen soon with another 'AI winter' after people realize only n
270.
by snidane 6y ago
"My point today is that, if we wish to count lines of code, we should not regard them as “lines produced” but as “lines spent”: the current conventional wisdom is so foolish as to book that count on the wrong side of the ledger."

More ›