kiyoto

18 ms·

121.
by kiyoto 12y ago
Presto is an amazing open source MPP engine. It has excellent architecture and an active community. We ( http://www.treasuredata.com ) use it extensively as one of of our big data SaaS query engines (also we contribute back a lot
122.
by kiyoto 12y ago
For those that dislike paginating through a longform (especially not for DFW whose copious endnotes is part of his literary form), here is a single-page URL: http://www.gourmet.com/magazine/2000s/2004/08/
123.
by kiyoto 12y ago
>I find that most of the time, "Big Data" isn't really all that big for modern hardware, and so going through all of the extra software work for specialized data stores isn't really all that necessary. YMMV, of course
124.
by kiyoto 12y ago
Logging to files creates a lot of headache. I would say the tail plugin for Fluentd (the open source log collector that I am a maintainer of: www.fluentd.org), I would say 1/3 to 1/2 of the questions are related to tailing log fil
125.
by kiyoto 12y ago
>Sure, relatively modern (RFC5424) syslog protocol has structured data too, but in my experience most software had never bothered to use it. So, forcing a switch through introducing another protocol that has structured data baked-in isn&
126.
by kiyoto 12y ago
In the end, it comes down to economics and how fungible goodwill/vanity/reputation/time/money are. As someone who works as both a maintainer and community manager of an open source project, I find it naive to think that
127.
by kiyoto 12y ago
They are different links (this one coming from the acquirer Microsoft). It's interesting to see how the two sides spin the acquisition.
128.
by kiyoto 12y ago
Sorry, my opener was misleading. I intentionally did not comment about the less educated because (at the cost of sounding elitist) I know very few of them personally. I'd love to hear about depression among the uneducated (I would not
129.
by kiyoto 12y ago
Here is what I consider to be a more accurate portrayal: Depression is an issue that plagues pretty much all of the educated America, which significantly overlaps with tech these days.
130.
Crime Fiction(newyorker.com)
3 points by kiyoto 12y ago|0 comments
131.
Math, Dropbox and the Importance of Asking Why(artofproblemsolving.com)
2 points by kiyoto 12y ago|0 comments
132.
by kiyoto 12y ago
>The logging and monitoring tools are /worse/ than in a BSD or SysV init situation. Journald, as opposed to rsyslog and syslog-ng I have to agree. I am one of the main people to support Fluentd (an open source log collector ht
133.
by kiyoto 12y ago
My only quip about this JSX is nomenclature: Oku et. al. at DeNA open-sourced a typed variant of ECMAScript under the exact same name a couple of years earlier: http://jsx.github.io/ With Facebook's brand and recogniti
134.
Real Time Processing: Storm-Trident vs Spark-streaming(realtime-cachedmind.tumblr.com)
7 points by kiyoto 12y ago|0 comments
135.
by kiyoto 12y ago
>I realize this might be difficult to account for, a lot of analytics actually just happens in Excel. For quick and dirty statistics or basic linear regressions, Excel represents a widely known quantity. In particular, I've been stu
136.
by kiyoto 12y ago
>However, a key aspect of log analysis is to understand the format of the arriving log data, especially in a heterogeneous environment where different applications may be developed using different log formats and network protocols to sen
137.
by kiyoto 12y ago
Grafana nearly doesn't get the attention it deserves. It is a compelling alternative to Elasticsearch+Kibana if you are less concerned about search and more concerned about analytic questions supported by Graphite/InfluxDB.
138.
by kiyoto 12y ago
Yes. For example, to follow CS229's lecture notes, the following material should suffice. - Linear Algebra Done Right by Sheldon Axler - Linear Algebra by Steven Levandosky - Linear Algebra and Multivariable Calculus, and Manifolds by
139.
by kiyoto 12y ago
Here is a math major's perspective (I also have a C.S. master's from Stanford, a decent school for computer science). The real reason statistics is losing to machine learning is M&M: money and marketing. Money is a huge factor
140.
by kiyoto 12y ago
In the case of Dropbox, 4 months ago, I speculated about the motivations behind the Carousel product: http://kiyototamura.tumblr.com/post/82662241570/dropboxs-car... While Carousel itself is considered to be a flo
141.
by kiyoto 12y ago
Thanks for the great summary. I totally agree with the whole opportunity thing.
142.
by kiyoto 12y ago
>Everyone, even people who aren't smart, can try hard and get better. Yes, I agree. What I tried to convey is the importance of balance between hard work and a degree of fatalism. You can't solve a lot of things with hard work,
143.
by kiyoto 12y ago
I find this campaign/propaganda dangerous. I only know of Japan and the US, but as someone who went to one of the most prestigious secondary schools in Japan and universities in the US, I have seen well-educated, smart people with &quo
144.
by kiyoto 12y ago
I totally hear you. As a quantitative analyst, I did something similar for years (I personally cherish the experience. I became very good at hacking together stuff fast =p). Would you be interested in leveraging your skills AND learning abo
145.
by kiyoto 12y ago
Hey there- I am pleased to see a company like yours cropping out of YCombinator. Not for nothing but: get some help with your website. It might seem like such a frivolous thing, but having a well-designed website goes a long way (or rather,
146.
Thorium-based Nuclear Power(en.wikipedia.org)
1 points by kiyoto 12y ago|0 comments
147.
by kiyoto 12y ago
If cancer research is anything like high frequency trading and time series analysis (which I used to work on), then one heinous thing about corrupted data is inter-dependencies among different data processing tasks: if data coming in "
148.
by kiyoto 12y ago
>However I think there is also plenty of room for improvement in the ETL process that doesn't necessarily mean a one-stop solution. I agree with you here as well. I recently wrote a blog article about this, at least for log data &gt
149.
by kiyoto 12y ago
While I am all for companies and software to expedite data cleaning, I don't think any software can cleanly solve this problem in the near future. 1. Data hygiene issues show up inconsistently, even within the same data source: I exper
150.
A Sum of Uncountable Positive Numbers is Infinite(kiyototamura.tumblr.com)
3 points by kiyoto 12y ago|0 comments

More ›