7 ms·
This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others
by la64710 4y ago
This is precisely why they should really open source their model so that anyone can download and run it on their own infrastructure. Just like google or others have done and one is free to run it on their own laptop (some even without a GPU) , on premise or on any cloud provider infrastructure. They can continue to provide a hosted service for their model but they should allow it to be downloaded just like BERT.
- bleuuuu 4y ago[dead]
- la64710 4y agoNot sure why this gets downvoted. But sometimes HN just cannot take the truth.
- jelder 4y agoProbably because you posted this three times.
- la64710 4y agoNo that was after I got downvoted.
- rom-antics 4y agoMaybe if you post it a few more times your luck will change
- DonHopkins 4y agoOnce all the GPTChat hn karma farming bots come back online.
- TOMDM 4y agoCorrelating user activity over periods of OpenAI API downtime would be an interesting activity. "Okay guys, the API is down, you have until it's back up to talk to me about pink pigeons (or any other unpredictable topic of the referees choice you couldn't batch responses to ahead of time) to raise my confidence that you are in fact not a bot"
- corobo 4y agoWhen I loaded the page you had posted this one 7 min ago and the other two 4 min ago. 7 min was the third time I'd read your comment so I downvoted it. Can't speak for anyone else but aye it's definitely because you posted the same thing thrice for me. The first version (topmost rated) of your comment doesn't seem to be downvoted
- deleted 4y ago[deleted]
- shric 4y agoIt might be the fact that you spammed identical posts at least 3 times in these comments
- 29athrowaway 4y agoIt takes a fortune to pay for the computing infrastructure to train a model. It takes an additional fortune to pay humans to do RLHF (reinforcement learning from human feedback). It takes an additional fortune to serve the model. There are also researchers getting paid there that live in one of the most expensive hubs in the world.
- la64710 4y agoThat’s fine .. but do you think Google didn’t do it? There is more at stake here than just dollars.
- 29athrowaway 4y agoTheir research business units (cost centers) are financed with revenue from their profit centers (adtech).
- rom-antics 4y agoI have a feeling ChatGPT requires hundreds of GB of GPU RAM, so no, you couldn't run it on your laptop.
- la64710 4y agoChatGPT might but The LLLM model may not require so many nodes specially if someone is running for their own dataset.
- spullara 4y agoYou can train GPT-J, etc on your own dataset but that won't get you the same results unless you train it on almost all the high quality content on the internet and spend millions of dollars on gpus.
- cellis 4y agoGPT NeoX (open source) requires at least 45GB of GPU ram. So no, you're not running it on your laptop.
- DonHopkins 4y ago[flagged]
- ipython 4y agoWouldn’t that run on a new MacBook Pro m2 with 96gb of unified ram?
- narrator 4y agohttps://www.reddit.com/r/PygmalionAI/ https://www.reddit.com/r/PygmalionAI/ is one. Mainly people are using it as an alternative to http://character.ai http://character.ai which people have said used to be incredible but has been slowly degrading in quality as it has grown more popular. The 6B parameter model, which is the only one that is even worth running according to many users, only runs on cards with 16gb of vram or Google Colab Cloud Service and people say it's not as good as character.ai. There are other huge models like Bloom that are more general purpose, but they require greater than 24GB of ram which means multiple linked GPUs to even run them much less train them. Thus, unlike stable diffusion, chatbots that run on common consumer GPUs are going to need some work to be competitive with commercial offerings.