mziel

8 ms·

31.
by mziel 10y ago
While obviously the answer is libraries and data types (DataFrame is a very powerful semantic, replicated later in Python, Julia, Scala/Spark), R definitely IS a functional language: - closures, lambdas - high-order functions - a lot R
32.
by mziel 10y ago
hetero-004 algs4partI-010 algs4partII-007
33.
by mziel 10y ago
I think R's data frames is by far the most intuitive abstraction. There's a reason why it was duplicated in Python, Spark or Julia. And R has a lot of utilities for converting input strings, dates, JSON etc.
34.
by mziel 11y ago
I can see that Wes is a reporter for Spark issue ( https://issues.apache.org/jira/browse/SPARK-13534 ), what are the plans (if any) for tighter Spark/Python/R DataFrames integration?
35.
by mziel 11y ago
It only works once. My usual response to such practices is to not return to the store again (and probably buy online). They lose in the long run.
36.
by mziel 11y ago
Could you post a link to this talk?
37.
by mziel 11y ago
Agreed. Our hourly wage does not equal the amount of hard work during that hour. It's also a (amortized) function of all the years you've spend in or outside of school perfecting your skills.
38.
by mziel 11y ago
Not a FB user, but actually it can't be uninstalled. I had an Android phone with no FB (I probably deleted it after I got the phone), and after the system upgrade it got installed without me agreeing to it. And I can't seem to und
39.
by mziel 11y ago
Last Spark Summit the videos were up on Youtube 1-2h after each talk. Anybody knows where to find the ones from this summit?
40.
by mziel 11y ago
If you want to go over data-frame in parallel just replace call to lapply() with mclapply(). I agree about 3 OO systems, but let's not mix things up here. Casual user (who doesn't know sapply) doesn't interact with that.
41.
by mziel 11y ago
YMMV, but I think this is pretty clear: "lapply returns a list of the same length as X, each element of which is the result of applying FUN to the corresponding element of X" == lapply is a map() construct that takes a list and a
42.
by mziel 11y ago
For R at least some of it is due to R's flexibility x$name syntax stems from data frames being really lists in disguise x[["name"]] ditto, plus because it's useful to access by string (see reflection in other languages)
43.
by mziel 11y ago
I think it's also due the fact that installing R package is just one command away, install.package("abc") and library(abc) and you're done. It a blessing, but encourages loading swaths of libraries.
44.
by mziel 11y ago
Factor is one of the worst thing of R-world. I don't recall ever needing factors, yet they creep in with many functions (read.csv, cut). Btw there's a nice readr package (from Hadleyverse) that has a read_csv method that does away
45.
by mziel 11y ago
The problem is people using R without trying to learn about the language itself, just assuming it works like their favourite language. For example complaining that R is slow and then writing iterative solution instead of using vectorization
46.
by mziel 11y ago
And lists + dataframes as first class citizens. Everything (including dataframes) is pretty much a list. Most R packages nowadays have dataframes in the centre of implementation. Compare it to other languages, lots of code is needed to conv
47.
by mziel 11y ago
That sounds very interesting. Is there any ticket, where I can follow the progress on the batch columnar format you mentioned? Btw, I was critical about the issue above, but I do love Spark, using it on a daily basis. :)
48.
by mziel 11y ago
New statistics/machine learning algorithms are always welcome, but the big plus for productionizing is ML pipelines persistence. That said, during Spark Summit Databricks guys themselves were most excited about Dataset API. Looking for
49.
by mziel 11y ago
To be honest PySpark and SparkR are always going to be 2nd category citizens (because of the serialization/pickling between the two environments). Databricks shows nice graphs, saying they are equivalent for DataFrames, however those c
50.
by mziel 11y ago
Just. What about the coordinating those? What about review system for drivers?
51.
by mziel 11y ago
Not the OP, but there's no such thing as proper experimental setup in economics (because there can't be). That's why using economic/econometric modelling for causal inference is the holy grail of the field. Some approach
52.
by mziel 11y ago
I think this is happening to a degree. I know of a guy, whose younger brother started reading up on physics after Big Hero 6. Also didn't older tech-related movies on hackers inspire some of us?
53.
by mziel 11y ago
For the lazy: http://research.microsoft.com/pubs/255952/ICCV15_DeepNDF_mai... From abstract: "(...) we introduce a stochastic and differentiable decision tree model, which steers the representation learning
54.
by mziel 11y ago
Not-technical "The World's Toughest Endurance Challenges" - Very nicely illustrated "Thing Explainer: Complicated Stuff in Simple Words" - Extremely enjoyable. People here certainly are aware of xkcd and it's
55.
by mziel 11y ago
Nice list, but Spark is treated superficially. Also extremely out-dated (Shark, Bagel). SparkSQL should be in the SQL-on-Hadoop section. MLlib+ML should be in Machine Learning section. If we include Storm and Giraph, we should include Spark
56.
by mziel 11y ago
It's not. Let's assume that ">" means probability of winning over 0.5 Federer > Djokovic (well not lately) Djokovic > Nadal Nadal > Federer Everything depends on the draw. Same with the initial choice of dice
57.
by mziel 11y ago
Depends on your settings. (right click -> options) I have uBlock (additional lists) and Ghostery (block all) and don't see that.
58.
by mziel 11y ago
See other comments. Signed admission doesn't mean anything without 3rd party verification. I've never seen a published log. Link?
59.
by mziel 11y ago
I don't think they understand confidence intervals, or at least they think they do but they get it wrong. It's the same as misunderstanding p-value. Confidence interval of 95% means that the estimator produces an interval that con
60.
by mziel 11y ago
Yes, I'm aware of that. But without 3rd party we're basically trusting the participants that it didn't happen. E.g. "I'll give you $500, but you also have too sign an NDA, so that people don't know we cheated.&

More ›