4 ms·
I read this one a few months back & felt, like most programmers, that it was an awesome article, but I would forget all of it unless I rewrote everything from s
by dxbydt 13y ago
I read this one a few months back & felt, like most programmers, that it was an awesome article, but I would forget all of it unless I rewrote everything from scratch all by myself :) So here's my rewrite in Scala - its not realtime, but still takes only 4 minutes on my laptop for a typical weekly dataset, so you can put it on a cron schedule & get a trending topics with a 5 min delay. Ofcourse, no storm, no hadoop etc. just a plain old scala program anybody can run on their laptop. http://bit.ly/J82szS http://bit.ly/J82szS
- pinhead 13y agoMaybe check out Spark [1], it primarily supports Scala and they have great streaming functionality that seems to beat out Storm and others in terms of performance for some workloads [2]. [1] http://spark.incubator.apache.org/ http://spark.incubator.apache.org/ [2] http://www.cs.berkeley.edu/~matei/papers/2013/sosp_spark_streaming.pdf http://www.cs.berkeley.edu/~matei/papers/2013/sosp_spark_str...