rxin

16 ms·

151.
Announcing Apache Spark 1.1(databricks.com)
60 points by rxin 12y ago|13 comments
152.
by rxin 12y ago
It is an oversimplification to link "Chinese students are usually very weak on independent thinking" to "many Chinese students fail to make the best use of their time here". Many American students also fail to make the b
153.
by rxin 12y ago
Author of the GitHub repo here. I wanted a list of papers that would be essential in building database systems. It was little bit sad to see many members of the community re-discovering and re-inventing the wheels from 30+ years of relation
154.
by rxin 12y ago
Thanks for posting, but you should change the title to Zhang Lei instead of Zhang Le.
155.
by rxin 12y ago
I had the same thought! Apache Spark 1.0 is actually going to support lambda functions in Java 8. A pretty big deal for making Java programmers' life easy.
156.
by rxin 13y ago
Going from Hive/Pig to Spark enables substantial improvement in developers' productivity (for non-reporting/BI workloads). You can properly unit test your program, use a debugger, and have all your code in the same place in t
157.
by rxin 13y ago
There is also a Python shell now :)
158.
MapReduce and Spark(vision.cloudera.com)
65 points by rxin 13y ago|14 comments
159.
by rxin 13y ago
What about comparing mainland and Taiwan? I don't think there exists an obvious conclusion from this comparison if you look at status quo. If you are judging based on the situation before 2000s, I agree with you that there is an obviou
160.
by rxin 13y ago
Spark goes much more beyond just in-memory caching. It features a more advanced scheduler and a higher level programming abstraction. The programming abstraction treats all data as collections (RDD in Spark terminology), and allow programme
161.
by rxin 14y ago
What about Cloudera?
162.
by rxin 14y ago
Jim Gray wrote a classic paper about this. "The 5 Minute Rule for Trading Memory for Disc Accesses and the 5 Byte Rule for Trading Memory for CPU Time". http://www.hpl.hp.com/techreports/tandem/TR-86.1.pdf There is an updated version that
163.
by rxin 14y ago
Even with parallel processing, assuming you can handle 1G of data per node per second (which is a fairly optimistic estimation for on disk data): 1G/node/sec * 100 nodes * 2 sec = 200G. 17TB is 85 times that number.
164.
by rxin 14y ago
Check this out: http://blinkdb.org/ A new research collaboration between UC Berkeley and MIT on probabilistic query answering. It allows users to specify trade-off between error confidence bound vs time.
165.
by rxin 15y ago
IBM was turned around by a formater McKinsey consultant, Louis Gerstner.
166.
Computer Science for the Rest of Us (Non-Computer Scientist)(nytimes.com)
57 points by rxin 15y ago|13 comments
167.
by rxin 15y ago
It has videos from last year (Spring 2011). Videos for this year's offering should be posted online later.
168.
by rxin 15y ago
Try the course name, minus the "intro to", in one word.
169.
by rxin 15y ago
This year's offering has some changes from the Spring 2011 version of the course (the assignments are all different), but you can view the Spring 2011 at http://datascienc.es/spring-2011-course/
170.
Intro to Data Science at UC Berkeley taught by Jeff Hammerbacher(datascienc.es)
165 points by rxin 15y ago|24 comments
171.
by rxin 15y ago
I wonder whether this is related to recent introduction of leaderboards in Google Latitude check-ins.
172.
Jvm performance tuning (notes)(umbrant.com)
94 points by rxin 15y ago|8 comments
173.
Computer Scientists May Have What It Takes to Help Cure Cancer(nytimes.com)
5 points by rxin 15y ago|0 comments
174.
by rxin 15y ago
I don't see why it is necessary for the desktop. Gmail web app already supports notifications and file attachment drag-and-drop (if you use Chrome). And on desktop, you have much more resource and don't need to worry about closing the gmail
175.
Congress declared pizza is a vegetable(huffingtonpost.com)
3 points by rxin 15y ago|0 comments
176.
by rxin 15y ago
Support for joining two very large tables is nice, but isn't really a super big deal. In a typical warehouse star schema, you have a very very large fact table, and a number of dimension tables. The dimension tables tend to be small.
177.
United States Patent: Method of exercising a cat(google.com)
17 points by rxin 15y ago|4 comments
178.
by rxin 15y ago
Such a link bait? I don't see how he can go from Will's comment to: Regarding Will's comment: If Google's products were secure out of the box, journalists would not need to "take a couple hours" to learn to protect their data and communicat
179.
Software is not Science(matt-welsh.blogspot.com)
7 points by rxin 15y ago|0 comments
180.
by rxin 15y ago
The student visa (F1) allows foreigners to work for a year (OPT) after graduation.

More ›