3 ms·

Direct link to paper: https://distill.pub/2021/multimodal-neurons/ https://distill.pub/2021/multimodal-neurons/

by colah3 6y ago

jtsiskin 6y ago
It’s very cool that this interactive HTML is the actual published and peer reviewed ‘paper’. I didn’t know such journals existed
- d110af5ccf 6y ago
  I don't know, I have pretty mixed feelings about the whole thing. In theory, it appears that the articles are supposed to be self contained Git repositories. In practice, this article loads a bunch of assets from Google's Cloud Storage. Blocking them appears to partially break various bits in subtle ways - figure 6 is particularly bad. It also fails to render correctly without a couple third party scripts hosted by Cloudflare. It's hardly an ideal state of affairs. Articles that aren't self contained make it frustratingly difficult to view offline copies. They also raise the possibility of the publication changing over time as anything hosted by a third party is outside the control of the journal. This lack of an immutable version is highly concerning because it means that no single canonical form exists for incorporation into the scholarly record. (Note that even redacted, entirely fraudulent papers have traditionally remained available from the original publisher with appropriate warning labels attached.) Reflowable text and interactive figures are very welcome additions, but the concept of a mutable scientific literature is absolutely horrifying.
  - jtsiskin 6y ago
    Oh wow, did not realize it was loading from external sources. Totally agree it should be completely self contained and versioned
skybrian 6y ago
Figure 1 has an intriguing caption: "You can click on any neuron to open it up in OpenAI Microscope to see feature visualizations, dataset examples that maximally activate the neuron, and more." I have been unable to get this to work. Does it work for anyone else? (Each neuron has a dropdown menu, but it sounds like there's more to it.)
- colah3 6y ago
  Oh woah, thanks for catching that! The ability to change each neurons facet on hover was added towards the end, but seems to be blocking one from clicking the <a> tag.

Direct link to paper: https://distill.pub/2021/multimodal-neurons/ https://distill.pub/2021/multimodal-neurons/

by colah3 6y ago

Direct link to paper: https://distill.pub/2021/multimodal-neurons/ https://distill.pub/2021/multimodal-neurons/

It’s very cool that this interactive HTML is the actual published and peer reviewed ‘paper’. I didn’t know such journals existed

d110af5ccf 6y ago
I don't know, I have pretty mixed feelings about the whole thing. In theory, it appears that the articles are supposed to be self contained Git repositories. In practice, this article loads a bunch of assets from Google's Cloud Storage. Blocking them appears to partially break various bits in subtle ways - figure 6 is particularly bad. It also fails to render correctly without a couple third party scripts hosted by Cloudflare. It's hardly an ideal state of affairs. Articles that aren't self contained make it frustratingly difficult to view offline copies. They also raise the possibility of the publication changing over time as anything hosted by a third party is outside the control of the journal. This lack of an immutable version is highly concerning because it means that no single canonical form exists for incorporation into the scholarly record. (Note that even redacted, entirely fraudulent papers have traditionally remained available from the original publisher with appropriate warning labels attached.) Reflowable text and interactive figures are very welcome additions, but the concept of a mutable scientific literature is absolutely horrifying.
- jtsiskin 6y ago
  Oh wow, did not realize it was loading from external sources. Totally agree it should be completely self contained and versioned

skybrian 6y ago

Figure 1 has an intriguing caption: "You can click on any neuron to open it up in OpenAI Microscope to see feature visualizations, dataset examples that maximally activate the neuron, and more." I have been unable to get this to work. Does it work for anyone else? (Each neuron has a dropdown menu, but it sounds like there's more to it.)

colah3 6y ago
Oh woah, thanks for catching that! The ability to change each neurons facet on hover was added towards the end, but seems to be blocking one from clicking the <a> tag.