kiyoto

10 ms·

61.
by kiyoto 12y ago
Some folks in the Fluentd community uses Graylog2+Fluentd as an alternative to EFK (Elasticsearch Fluentd Kibana) See http://www.fluentd.org/guides/recipes/graylog2
62.
by kiyoto 12y ago
>Looks good for the basics, but as some other folks mentioned here, it would benefit from some articles about design, and even more importantly, rationale. I agree about rationale, but probably in a different way. For a great many people
63.
StrataConf: As Hadoop Stoops, Machines Learn and Spark(blog.treasuredata.com)
1 points by kiyoto 12y ago|0 comments
64.
by kiyoto 12y ago
Interesting. This can be used with Fluentd as well with the JSONFormatter ( https://www.fluentd.org )
65.
by kiyoto 12y ago
Treasure Data ( https://jobs.lever.co/treasure-data ), where I've been for the last three years, employs several people to work exclusively on Fluentd, an open source project ( https://www.fluentd.org ) We do t
66.
by kiyoto 12y ago
>More interestingly, things like revenue/visitor have a known probability distribution. This actually depends. Based on my experience at a very early stage startup, it was definitely not the case for some datasets (I even tried fidd
67.
by kiyoto 12y ago
I agree. Bootstrapping is somehow not covered in most "first course in statistics" yet it is very valuable in practice for data people, especially at startups: Because you don't have that much data, and most of your data do n
68.
by kiyoto 12y ago
For the logging layer, have you considered/looked at Fluentd? Disclaimer: I am a Fluentd maintainer and would love to hear feedback from folks.
69.
by kiyoto 12y ago
Some people like using Grafana with InfluxDB backend and Fluentd for log collection.
70.
by kiyoto 12y ago
A great article. A couple of open source projects for CEP/event processing. 1. Esper ( http://www.espertech.com ) has been around for awhile. This is the CEP engine a lot of people are familiar with. 2. Norikra ( http:&#x2F
71.
by kiyoto 12y ago
Not quite. I used to be a 'data scientist' in finance. Their jargon for this position is "quantitative analyst". The two definitely have intersections. Here is what's in DataScience \cap Statistics 1. A solid unders
72.
by kiyoto 12y ago
(Disclaimer: I am a Fluentd maintainer) Here are some comparisons out in the wild (Note: neither of them is a Logstash or Fluentd maintainer afaik) - http://jasonwilder.com/blog/2013/11/19/fluentd-vs-logs
73.
by kiyoto 12y ago
It is not "better" but different. 1. Easier to extend that syslog-ng if you have a modest knowledge of Ruby 2. Easy to configure file- and memory- based buffering and failover. 3. Advanced filtering out of the box. 4. Rich plugin
74.
by kiyoto 12y ago
Glad to hear that! I wrote https://www.digitalocean.com/community/tutorials/elasticsear... a while back.
75.
by kiyoto 12y ago
Some people find EFK (Elasticsearch Fluentd Kibana) to be another compelling alternative to Splunk (Disclaimer: I am one of the maintainers of Fluentd) http://docs.fluentd.org/articles/free-alternative-to-splunk-...
76.
by kiyoto 12y ago
"The bottom line is that we realize we have to continually raise the bar, to get you home from the bar. We are aware of this challenge, from both a technological as well as people perspective, and are doing what we can to fulfill our m
77.
by kiyoto 12y ago
First of all, John Foreman is great. Read his book "Data Smart" and http://analyticsmadeskeezy.com/blog/ (disclaimer: I am in no way tied to John Foreman. Also, I work at a company that provides a data proces
78.
by kiyoto 12y ago
As a math major who went to grad school in CS theory, I find the article's title vexing. It projects a faux dichotomy of computer scientists v. mathematicians when, in reality, it's mathematicians v. mathematicians. Many areas of
79.
by kiyoto 12y ago
It depends on where you look. If anything, anime/manga (or anything that is categorized/miscategorized under the Otaku category) are gaining wider adoption in the West by the day, and for music, "Baby Metal" is gaining t
80.
by kiyoto 12y ago
>If you can talk intelligently about the whole grab bag of stuff these teams use, that'll get you in the door. Understanding RDBMSes, data warehousing concepts, and ETL is a big plus for people doing infrastructure work. This is sad
81.
by kiyoto 12y ago
So, I've been talking to a lot of Uber/Lyft drivers, and while I have no carefully tabulated data to quantify my point, I must say Lyft drivers complain less than Uber drivers (at least not explicitly) about their respective emplo
82.
by kiyoto 12y ago
First of all, congratulations to Aaron Levie and Box. This is a tremendous journey of perspicacity and grit. Here is a write-up about Aaron Levie's journey by his friend Om Malik: https://gigaom.com/2014/03/24
83.
Real-time logs analysis using Fluentd and BigQuery(cloud.google.com)
2 points by kiyoto 12y ago|0 comments
84.
Patrick Collison on Linkedin(linkedin.com)
3 points by kiyoto 12y ago|0 comments
85.
by kiyoto 12y ago
I still miss Thinkpad's keyboards before the current chiclet era.
86.
by kiyoto 12y ago
Yea, I am a big fan of that book. I tend to think of it as a well-executed troll against the fad-driven, toolchain-crazed "data scientist" communities.
87.
by kiyoto 12y ago
This theory explains why many smart people also read a lot. Not necessarily books or even any body of text, but reading as a generic behavior to find meanings in various objects and events in life (Books, I feel, is just one of the easiest
88.
by kiyoto 12y ago
Looking at the port number, it looks like Clever is a MongoDB user =)
89.
by kiyoto 12y ago
>Just let them first learn something (anything!!!) to get hooked onto the potential of programming, and then you can offer to show them the true light later. pgbovine nailed it. I learned this lesson from mathematics (I studied math in c
90.
Show HN: SQL Tutorial for Excel Users(blog.treasuredata.com)
6 points by kiyoto 12y ago|0 comments

More ›