4 ms·

Connor Leahy on EleutherAI, Replicating GPT-2/GPT-3, AI Risk and Alignment

84 points by antman 5y ago

greatpostman 5y ago
- upwardbound 5y ago
  Aren't Eleuther's models libre and free though? https://www.eleuther.ai/faq/ https://www.eleuther.ai/faq/ > Are the codebases free software? GPT-Neo is MIT-licensed, while GPT-NeoX is licensed under Apache 2.0. These are the most freely-termed licenses that we can provide for each codebase respectively. Mesh Transformer JAX is licenced under Apache 2.0. > Are the models free software? EleutherAI is licensing models under Apache 2.0. If you use our models, we would highly appreciate you citing or displaying your usage of them.
- andreyk 5y ago
  If you actually listen to this or just know what EleutherAI is (A grassroots collective of researchers working to open source AI research), it's very evident that this is not their goal at all
mrfusion 5y ago
If this is open source is there a good way to get involved?
- andreyk 5y ago
  You can hop on their discord looks like https://www.eleuther.ai/faq/ https://www.eleuther.ai/faq/
andreyk 5y ago
I'd recommend reading the blog post about their first year, it's really fun and informative https://blog.eleuther.ai/year-one/ https://blog.eleuther.ai/year-one/
sillysaurusx 5y ago
It was interesting to start the TPU Podcast discord server. I was annoyed Connor showed up and convinced the talented researchers to spend their time on his server. But now I get to claim correctly that Eleuther never would have started without me, so I’ll put that up on the trophy shelf. Which happens to be next to Shockley’s trophy shelf, across the hall from MySpace. It was a wild and fun ride. I ended up becoming a published, cited researcher thanks to Eleuther. https://twitter.com/theshawwn/status/1480479272078913539?s=21 https://twitter.com/theshawwn/status/1480479272078913539?s=2... I’ve always wanted to do a postmortem writeup of my attempt at starting an open source AI lab. It was always my goal from the very moment I pressed the “create server” button, and it’s at least mildly interesting that it was successful — in spite of my efforts, not because of my efforts. I do feel a pang of jealousy every time I see an article like this, and it would be nice if they’d occasionally link to our server (https://discord.com/invite/x52Xz3y https://discord.com/invite/x52Xz3y) rather than mentioning it, but (with effort) I managed to transmute those feelings into amusement. It would have been better if I felt amused from day one.
- tmabraham 5y ago
  Haha yesterday in #off-topic I called you the "grandfather of EleutherAI"
  - sillysaurusx 5y ago
    That fits! https://donkeykong.fandom.com/wiki/Cranky_Kong https://donkeykong.fandom.com/wiki/Cranky_Kong

84 points by antman 5y ago

greatpostman 5y ago

upwardbound 5y ago
Aren't Eleuther's models libre and free though? https://www.eleuther.ai/faq/ https://www.eleuther.ai/faq/ > Are the codebases free software? GPT-Neo is MIT-licensed, while GPT-NeoX is licensed under Apache 2.0. These are the most freely-termed licenses that we can provide for each codebase respectively. Mesh Transformer JAX is licenced under Apache 2.0. > Are the models free software? EleutherAI is licensing models under Apache 2.0. If you use our models, we would highly appreciate you citing or displaying your usage of them.
andreyk 5y ago
If you actually listen to this or just know what EleutherAI is (A grassroots collective of researchers working to open source AI research), it's very evident that this is not their goal at all

mrfusion 5y ago

If this is open source is there a good way to get involved?

andreyk 5y ago
You can hop on their discord looks like https://www.eleuther.ai/faq/ https://www.eleuther.ai/faq/

andreyk 5y ago

I'd recommend reading the blog post about their first year, it's really fun and informative https://blog.eleuther.ai/year-one/ https://blog.eleuther.ai/year-one/

sillysaurusx 5y ago

It was interesting to start the TPU Podcast discord server. I was annoyed Connor showed up and convinced the talented researchers to spend their time on his server. But now I get to claim correctly that Eleuther never would have started without me, so I’ll put that up on the trophy shelf. Which happens to be next to Shockley’s trophy shelf, across the hall from MySpace. It was a wild and fun ride. I ended up becoming a published, cited researcher thanks to Eleuther. https://twitter.com/theshawwn/status/1480479272078913539?s=21 https://twitter.com/theshawwn/status/1480479272078913539?s=2... I’ve always wanted to do a postmortem writeup of my attempt at starting an open source AI lab. It was always my goal from the very moment I pressed the “create server” button, and it’s at least mildly interesting that it was successful — in spite of my efforts, not because of my efforts. I do feel a pang of jealousy every time I see an article like this, and it would be nice if they’d occasionally link to our server (https://discord.com/invite/x52Xz3y https://discord.com/invite/x52Xz3y) rather than mentioning it, but (with effort) I managed to transmute those feelings into amusement. It would have been better if I felt amused from day one.

tmabraham 5y ago
Haha yesterday in #off-topic I called you the "grandfather of EleutherAI"
- sillysaurusx 5y ago
  That fits! https://donkeykong.fandom.com/wiki/Cranky_Kong https://donkeykong.fandom.com/wiki/Cranky_Kong