xtacy

18 ms·

1. 151.▲
   by xtacy 11y ago

   Oops, sorry, I didn't mean to say you used a RBF kernel. I edited my comment above. I meant to say your embedding resembles the polynomial kernel (not RBF, which was just meant as a generalisation of such neat tricks :)). What I mean
2. 152.▲
   by xtacy 11y ago

   Isn't the key insight -- to replace `w_{i,j}` by turning it into a vector with an inner product structure -- also known as the kernel-trick in machine learning? (here, they seem to use a polynomial kernel: https://en.wikiped
3. 153.▲
   by xtacy 11y ago

   It's also known as "automatic differentiation" -- it's quite different from numerical/symbolic differentiation. More information here: - https://justindomke.wordpress.com/2009/02/17/au
4. 154.▲
   The sleeping beauty paradox(stats.stackexchange.com)

   77 points by xtacy 11y ago|80 comments
5. 155.▲
   Kalman and Bayesian filters in iPython Notebook(nbviewer.ipython.org)

   2 points by xtacy 11y ago|0 comments
6. 156.▲
   by xtacy 11y ago

   Couldn't you generate data from within their data centres? 60Gb/s should be quite feasible. :)
7. 157.▲
   by xtacy 11y ago

   I just love iTerm2, but I feel it's slow and unresponsive at times (Garbage Collection?) compared to Apple's Terminal. I still keep using iTerm2 because of its features. If there is any way I can profile these slowness and submi
8. 158.▲
   by xtacy 11y ago

   Yep, that's right. Looking forward to the CPI numbers!
9. 159.▲
   by xtacy 11y ago

   Thanks, yes, I realised it wasn't really barrier-sync latency after I wrote the comment. :) I remember that the NSDI paper actually made an Amdahl's-law-like argument (they give it a new name) and did something to the tune of &quo
10. 160.▲
    by xtacy 11y ago

    I wonder: When the NSDI authors (or rxin) says a computation is communication bound, what do they mean? Is it network bandwidth or latency? I suspect it's latency: If you're bottlenecked on latency, the barrier-synchronised nature
11. 161.▲
    LSD Neural Network: Large Scale Deep Neural Net Visualizing Top Level Features(317070.github.io)

    7 points by xtacy 11y ago|0 comments
12. 162.▲
    by xtacy 11y ago

    You could try Torch libraries. There are a few examples on how to (almost) replicate some of Google's neural network models on Imagenet. Check https://github.com/torch/torch7/wiki/Cheatsheet#demos .
13. 163.▲
    by xtacy 11y ago

    Thanks again. I didn't know Z3 could handle formulae with real numbers. I will take a closer look at it. :) On the network firewall rules (at multi-tenant Azure, I presume), what were Z3's runtimes look like?
14. 164.▲
    by xtacy 11y ago

    Thanks for the detailed explanation. It's interesting to note that firewall rules are well captured in the predicate logic. Just curious: Have you encountered rules that cannot be cast into predicate logic framework in Z3?
15. 165.▲
    by xtacy 11y ago

    Interesting! Would love to hear more. What are the classes of firewall properties you can express in Z3?
16. 166.▲
    Sensible and NonsenSQL Aspects of NoSQL Hoopla (2013) [pdf](edbt.org)

    6 points by xtacy 11y ago|1 comments
17. 167.▲
    by xtacy 11y ago

    Discussion on reddit: https://www.reddit.com/r/science/comments/2vb2fa/no_big_bang...
18. 168.▲
    by xtacy 11y ago

    Many congrats to Matei! Well deserved.
19. 169.▲
    by xtacy 11y ago

    Something doesn't add up in your observation. (x,y,z) can't all be uniformly distributed in [-1,1] because of the constraint x^2+y^2+z^2=1.
20. 170.▲
    The Unreasonable Effectiveness of Mathematics in Natural Sciences(dartmouth.edu)

    1 points by xtacy 12y ago|0 comments
21. 171.▲
    by xtacy 12y ago

    While I understand the sentiment behind this post, I think it misses one crucial point: It costs time, effort, and very smart people to build the "Bugati"-like system as they describe, instead of the current systems (that are more
22. 172.▲
    by xtacy 12y ago

    Interesting. IIUC, what you're implying is that defining a metric defines the topology and they're equivalent. Isn't p_ij in t-SNE also derived from the distances themselves, where p_ij ~ student_t(d_ij, degrees_of_freedom)
23. 173.▲
    by xtacy 12y ago

    Ensemble (and also boosted) models: Very nice idea. I like the takeaway that meta-SNE idea is powerful to compare the space of models by through the lens of pairwise distances as a proxy for the distance metric. Are distances the definin
24. 174.▲
    by xtacy 12y ago

    Colah, your posts are really inspiring and thoughtful. Your thoughts about visualising the space of representations by looking at the properties of pairwise distance matrix is quite illuminating. It might be a nice empirical way to get a
25. 175.▲
    by xtacy 12y ago

    Nice article. I think the fact that testing if "X-caused-Y", by exploiting the fact that this is not symmetrical, has also been used by the "pseudo-causality" Granger causality test: http://en.wikipedia.org&#
26. 176.▲
    by xtacy 12y ago

    Could you explain why that snippet makes you decide that way?
27. 177.▲
    by xtacy 12y ago

    A similar library for Scala: http://squeryl.org/
28. 178.▲
    Frappe: Using clang to visualize large codebases [pdf](llvm.org)

    1 points by xtacy 12y ago|0 comments
29. 179.▲
    by xtacy 12y ago

    Thank you colah. Your blog posts are inspiring! It's a lot of hard work and effort; keep it up!
30. 180.▲
    by xtacy 12y ago

    Great, thanks for the pointers! I've tried momentum trick before and it has helped. I'll try rmsprop.