colah3

9 ms·

1. 31.▲
   by colah3 6y ago

   Oh woah, thanks for catching that! The ability to change each neurons facet on hover was added towards the end, but seems to be blocking one from clicking the <a> tag.
2. 32.▲
   by colah3 6y ago

   Feature visualizations are described in this article: https://distill.pub/2017/feature-visualization/ The ones you see in this work are mostly a variant of the standard feature visualization, which tries to show d
3. 33.▲
   by colah3 6y ago

   Direct link to paper: https://distill.pub/2021/multimodal-neurons/
4. 34.▲
   by colah3 6y ago

   I'm really excited about the dream that we'll be able to learn from neural networks. Shan Cater and Michael Nielsen wrote a really inspiring article on this ( https://distill.pub/2017/aia/ ). I also wrote
5. 35.▲
   by colah3 6y ago

   I don't think English is the author's first language.
6. 36.▲
   by colah3 6y ago

   I'm curious if you feel the same way about programming -- do bad variable and function names only increase the difficult of understanding someone else's code or library by 0.001%?
7. 37.▲
   by colah3 6y ago

   > if you're journal is reaching so many people ... Just to clarify, impact factor measures the average impact of a paper, not the total impact of the journal. In fact, it divides by the number of papers! So it's much easier to
8. 38.▲
   by colah3 6y ago

   We've sometimes discussed it in the context of whether we can "scale up" Distill. But I think at this point I expect us to just stay niche and volunteer focused.
9. 39.▲
   by colah3 6y ago

   Nope. There's money committed if we ever run the Distill Prize ($10K prizes recognizing outstanding scientific communication), but that's tied up in legal issues. For regular Distill, all the costs (several thousand dollars a year
10. 40.▲
    by colah3 6y ago

    Thanks for the response! Your apology makes me feel more positive about conversations on the internet. :) I genuinely appreciate you giving feedback. Running Distill is hard, and there's lots of places we make mistakes or could do thin
11. 41.▲
    by colah3 6y ago

    Thanks for pointing this out! The slack invite link expires periodically and I need to replace it. It should work as soon as changes propagate! In the mean time, you can also join here: https://join.slack.com/t/distillp
12. 42.▲
    by colah3 6y ago

    Hello! I'm one of the editors of Distill. I'm certainly open to the possibility that we could have helped the authors differentiate their contribution more. It seems like it's important to you to call Distill out on what you
13. 43.▲
    by colah3 6y ago

    Thanks for your comment! I'm one of the editors of Distill. I understand the task to be different from regular pixel segmentation in that it's set up in the cellular automata context and message passing is only allowed between nei
14. 44.▲
    by colah3 6y ago

    That makes sense. I think the authors actually submitted the latest article, but the community jumped on this one. Their submission: https://news.ycombinator.com/item?id=24295756 Any chance you could consolidate this one in
15. 45.▲
    by colah3 6y ago

    [Disclosure: I'm involved in Distill, so a little biased.] Firstly, make sure you click through to the invidudal articles and try the interactive demos at the top of each one: * https://distill.pub/2020/growing-ca&
16. 46.▲
    by colah3 6y ago

    I've been incredibly lucky to work with Alex on several projects, including DeepDream. He's amazing. If you think you have a new idea about how to understand neural networks, there's a decent chance Alex did a prototype of it
17. 47.▲
    by colah3 7y ago

    Thank you! I've been pretty obsessively thinking about meta-science issues around interpretability for the last six months or so. :) A notable researcher privately told me that they think all interpretability research is nonsense. As s
18. 48.▲
    by colah3 7y ago

    I expected it to -- graphically, it looks very similar to Penrose notation! -- but at first glance it seems to be quite different. Penrose notation is very high level: edges correspond to tensor dimensions, joining corresponds roughly to te
19. 49.▲
    by colah3 7y ago

    We're still ramping up. So far, our only publication has been co-authoring Activation Atlases with our wonderful colleagues at Google ( https://distill.pub/2019/activation-atlas/ ). One thing we're thinkin
20. 50.▲
    by colah3 7y ago

    Thanks! This particular article went through pretty extensive feedback with colleagues where I'd print the article out, share it, and get hand written feedback. This necessitated investing in print formatting. :)
21. 51.▲
    by colah3 7y ago

    Hello! Thanks for pointing out that my CV is out of date. You're right that none of my work over the last two years is listed there, and I should probably fix that. It feels a bit awkward to chime in, but it feels a bit important becau
22. 52.▲
    by colah3 7y ago

    Hello! The Thiel Fellowship was a wonderful period for me, and gave me a lot of freedom to work on different topics. I'm very grateful for it. Unfortunately, the Fellowship only lasts for two years. Towards the end, it was actually sup
23. 53.▲
    by colah3 8y ago

    Jochen (who's website you linked) is the lead author of the paper. The line under the byline reads: > This article was presented at VISxAI, it is now under review at distill.pub. An earlier version of this paper was presented at the
24. 54.▲
    by colah3 8y ago

    Hi! I'm one of the authors. We'd be happy to answer any questions. :)
25. 55.▲
    by colah3 8y ago

    Thanks for the feedback - I've updated my comment to express uncertainty. As I understand it, a big part of the green revolution, especially initially, was Borlaug developing a strand of wheat that was resistant to many common diseases
26. 56.▲
    by colah3 8y ago

    With regards to GMOs, the green revolution (as I understand it[1], partly using GMOs to increase food production, especially in developing countries) is often described as saving a billion lives. On a brief glance, I can't find a detai
27. 57.▲
    by colah3 9y ago

    It seems like OpenAI's Human Feedback research (in collaboration with DeepMind) is targeted at this sort of thing. They try to use human feedback to create more nuanced and aligned objectives. https://blog.openai.com/de
28. 58.▲
    by colah3 9y ago

    I'd like to offer a more optimistic counter view. I think it's likely that deep learning has stumbled upon something deep and profound. And now we're at the point of struggling to make sense of it. Of course things are messy:
29. 59.▲
    by colah3 9y ago

    Thanks! :)
30. 60.▲
    by colah3 9y ago

    > factorizing this giant matrix to identify "neuron groups" ... is a brilliant idea. As with many ideas in this article, Alex deserves all the credit. He's been doing that trick internally at Google for years. (In my expe