4 ms·
GPT-2 Here is one cool (and recent) research project using GPT-2 model weights. https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-an-neuron-in-gpt-2
by scottydog51834 4y ago
GPT-2
Here is one cool (and recent) research project using GPT-2 model weights.
https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-an-neuron-in-gpt-2 https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-a...
- fenomas 4y agoTFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?
- alwayslikethis 4y agoRealistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.