4 ms·
Is there a reason to expect it'd be significantly more expensive than current-gen LLM? Reading the "Implementation Details" section, this was done with GPT2-med
by jamilton 3y ago
Is there a reason to expect it'd be significantly more expensive than current-gen LLM? Reading the "Implementation Details" section, this was done with GPT2-medium, and assuming running it is about as intensive as the original GPT2, it can be run (slowly) on a regular computer, without a graphics card. Seems reasonable to assume future versions will be around GPT-3/4's price.
- 22c 3y agoAgreed! There's also no way this is 5 years away from being viable. I just checked the timestamps on my Dall-E Mini generated images. They're dated June 2022 This is what people were doing on commodity hardware back then: https://cdn-uploads.huggingface.co/production/uploads/1655372600588-62a38c9086968c944929cedb.png https://cdn-uploads.huggingface.co/production/uploads/165537... This is what people are doing on commodity hardware now: https://civitai.com/images/3853761 https://civitai.com/images/3853761 I'm not even going to try to predict what we'll be able to do in 2 years time; even when accounting for the current GenAI hype/bubble!
- johnnyanmac 3y agoPerhaps not, but it begs the question of if GPT is affordable for a dev to begin with. I don't know how they would monetize this sort of work so it's hard to say. But making game models probably requires a lot more processing power than generating text or static images.