4 ms·

Can you give us more details concerning your seniority/domain/tech stack?

by ak_111 4y ago

sillysaurusx 4y ago
Sure, if you think it’d help. Here’s the message I sent that got me the new job. The context is that they were pushing back a little bit during salary negotiation and asking for a resume, so I channeled my Jewish ancestors and went into full salesman mode: “ https://battle.shawwn.com/Shawn%20Presser's%20Resume.pdf https://battle.shawwn.com/Shawn%20Presser's%20Resume.pdf was the resume I used for Groq. I planned to update it after finishing out the year. In terms of my ML work, here's some highlights of my work prior to Groq: - A Newsweek article about various GPT work I did https://www.newsweek.com/openai-text-generator-gpt-2-video-game-walkthrough-most-tedious-1488334 https://www.newsweek.com/openai-text-generator-gpt-2-video-g... - I was the first to demonstrate that GPT-2 could play chess https://www.theregister.com/2020/01/10/gpt2_chess/ https://www.theregister.com/2020/01/10/gpt2_chess/ - ... which DeepMind referenced: https://twitter.com/theshawwn/status/1226916484938530819 https://twitter.com/theshawwn/status/1226916484938530819 - GPT-2 music https://soundcloud.com/theshawwn/sets/ai-generated-videogame-music https://soundcloud.com/theshawwn/sets/ai-generated-videogame... - Invented swarm training https://www.docdroid.net/faDq8Bu/swarm-training-v01a.pdf https://www.docdroid.net/faDq8Bu/swarm-training-v01a.pdf - Built books3, the largest component of The Pile, a training dataset for language models (later used to train GPT-J): https://arxiv.org/abs/2101.00027 https://arxiv.org/abs/2101.00027 - Started the first ML discord server, grew the community to >2k members (Eleuther was formed there) - Reverse engineered BigGAN’s model over the course of ~6mo to locate a bug in their open source implementation https://github.com/google/compare_gan/issues/54 https://github.com/google/compare_gan/issues/54 ML research makes me happy, so I’ll be doing it for the foreseeable future. @StabilityAI expressed interest in bringing me on to help fix problems with their diffusion training. I’d prefer to work with you, but if it’s not possible to increase the equity or salary offer, I understand. Are you sure you can’t bump it?” They bumped it. Anyway, I hope that was helpful. I don’t know how relevant my recession experiences are compared to, say, someone in webdev. But if you’re a talented dev and someone’s lowballing you, be sure to at least try to negotiate. Don’t let the recession fears prevent you from turning down an initial offer. That said, I recognize that there are loads of people in a position where they’d be thankful to have any work at all. And I imagine I’ll be in that position soon enough — 35 is getting too close to 55 for comfort.
- Der_Einzige 4y ago
  I love your background. I'm trying really hard to get my work with getting LMs to be able to write with syntactic constraints (like banning the letter E) to convert into a dedicated ML research role for awhile now. Seems it's relatively easy to get a fat title and money but harder to get a mandate to do research fill time. I got gwern to pick up my paper about this, so someone with influence saw my work and cared. But being the first to get LMs to play chess is a pretty big claim to fame. I hope history remembers the pioneers.
  - sillysaurusx 4y ago
    Keep it up! I believe in you. Keep trying to do research that yiu personally find interesting; doesn’t matter if it’s small, just that you’re into it. That’s always worked like a compass for me. And keep in touch. Feel free to DM on Twitter or anywhere else. It can get lonely when it feels like you’re laboring in obscurity, so I’m happy to cheer you on or give feedback. Good luck :)

Can you give us more details concerning your seniority/domain/tech stack?

by ak_111 4y ago

Can you give us more details concerning your seniority/domain/tech stack?

Sure, if you think it’d help. Here’s the message I sent that got me the new job. The context is that they were pushing back a little bit during salary negotiation and asking for a resume, so I channeled my Jewish ancestors and went into full salesman mode: “ https://battle.shawwn.com/Shawn%20Presser's%20Resume.pdf https://battle.shawwn.com/Shawn%20Presser's%20Resume.pdf was the resume I used for Groq. I planned to update it after finishing out the year. In terms of my ML work, here's some highlights of my work prior to Groq: - A Newsweek article about various GPT work I did https://www.newsweek.com/openai-text-generator-gpt-2-video-game-walkthrough-most-tedious-1488334 https://www.newsweek.com/openai-text-generator-gpt-2-video-g... - I was the first to demonstrate that GPT-2 could play chess https://www.theregister.com/2020/01/10/gpt2_chess/ https://www.theregister.com/2020/01/10/gpt2_chess/ - ... which DeepMind referenced: https://twitter.com/theshawwn/status/1226916484938530819 https://twitter.com/theshawwn/status/1226916484938530819 - GPT-2 music https://soundcloud.com/theshawwn/sets/ai-generated-videogame-music https://soundcloud.com/theshawwn/sets/ai-generated-videogame... - Invented swarm training https://www.docdroid.net/faDq8Bu/swarm-training-v01a.pdf https://www.docdroid.net/faDq8Bu/swarm-training-v01a.pdf - Built books3, the largest component of The Pile, a training dataset for language models (later used to train GPT-J): https://arxiv.org/abs/2101.00027 https://arxiv.org/abs/2101.00027 - Started the first ML discord server, grew the community to >2k members (Eleuther was formed there) - Reverse engineered BigGAN’s model over the course of ~6mo to locate a bug in their open source implementation https://github.com/google/compare_gan/issues/54 https://github.com/google/compare_gan/issues/54 ML research makes me happy, so I’ll be doing it for the foreseeable future. @StabilityAI expressed interest in bringing me on to help fix problems with their diffusion training. I’d prefer to work with you, but if it’s not possible to increase the equity or salary offer, I understand. Are you sure you can’t bump it?” They bumped it. Anyway, I hope that was helpful. I don’t know how relevant my recession experiences are compared to, say, someone in webdev. But if you’re a talented dev and someone’s lowballing you, be sure to at least try to negotiate. Don’t let the recession fears prevent you from turning down an initial offer. That said, I recognize that there are loads of people in a position where they’d be thankful to have any work at all. And I imagine I’ll be in that position soon enough — 35 is getting too close to 55 for comfort.

Der_Einzige 4y ago
I love your background. I'm trying really hard to get my work with getting LMs to be able to write with syntactic constraints (like banning the letter E) to convert into a dedicated ML research role for awhile now. Seems it's relatively easy to get a fat title and money but harder to get a mandate to do research fill time. I got gwern to pick up my paper about this, so someone with influence saw my work and cared. But being the first to get LMs to play chess is a pretty big claim to fame. I hope history remembers the pioneers.
- sillysaurusx 4y ago
  Keep it up! I believe in you. Keep trying to do research that yiu personally find interesting; doesn’t matter if it’s small, just that you’re into it. That’s always worked like a compass for me. And keep in touch. Feel free to DM on Twitter or anywhere else. It can get lonely when it feels like you’re laboring in obscurity, so I’m happy to cheer you on or give feedback. Good luck :)