3 ms·
First Open Source Alternative to ChatGPT Has Arrived
- ryao 4y agoWhy is ChatGPT not open source?
- donkeyboy 4y agoBecause it was developed by OpenAI, which is a company that wants to make money (for example through GPT-3 API calls). Historically, OpenAI has also been concerned that their SOTA models could be threatening to the world if released.
- elkos 4y agoYou can make money with open-source. It is a development and business methodology that people can make. Several early investors and venture capitalists might consider it a not ideal choice. Sure, it has it is pros and cons, but on the other hand people invested in FTX so people are biased. Disclaimer: I do work for a non-profit working in open-source and I am biased.
- orra 4y ago> company that wants to make money (for example through GPT-3 API calls). Right. > Historically, OpenAI has also been concerned that their SOTA models could be threatening to the world if released. That was clearly marketing spin. Just like the word “Open” in their name.
- intelVISA 4y agoThey're protecting us from AGI or something. ($$$)
- imranq 4y agoVery cool. It looks like you train your transformer model as normal and then fine tune it some more with a reward model
- tmabraham 4y agoNo it hasn't. I love lucidrains and he's a bona-fide genius, but I feel obligated to point out this is just code for training a ChatGPT-like model and not an actual trained model you can use.
- d4rkp4ttern 4y agoHow would we know if it would train the “same” model as ChatGPT ?
- ngcc_hk 4y agoIf it is the same kind we consider they are the same. This is like alpha go is closed but many open source model. But as said, you need not the model but like alpha go equivalent, you need a trained and tested set.
- dannyw 4y agoI knew lucidrains from the epicmafia web game he did. Miss it!
- thebeardisred 4y agoUhhh, weren't the EleutherAI folks (https://github.com/EleutherAI/gpt-neo https://github.com/EleutherAI/gpt-neo) first?
- thebeardisred 4y agoFor context, they're now working on a GPU driven version: https://github.com/EleutherAI/gpt-neox/ https://github.com/EleutherAI/gpt-neox/
- ilaksh 4y agoIs there a large trained PaLM model that is open source?