5 ms·
Are these models downloadable, like whisper? What’s the minimum hardware for running them? Would they run on a raspberry pi? Or a smartphone?
by nico 2y ago
Are these models downloadable, like whisper?
What’s the minimum hardware for running them?
Would they run on a raspberry pi?
Or a smartphone?
- jeffharris 2y agonot open source at this time. unfortunately they're much to large to run on normal consumer hardware
- echoangle 2y agoIs that the reason you're not open sourcing them? Wouldn't it still make sense to provide it for enthusiasts?
- famouswaffles 2y agoThey're not open sourcing it because it's just gpt. Both of the new models are gpt-4o(-mini?) with presumably different fine-tuning. They're obviously not going to open source their flagship gpt models.
- deleted 2y ago[deleted]
- coconut08 2y agowith devices having unified memory now we are no longer limited to what can fit inside of a 3090 anymore. consumer hardware can have hundreds of gigabytes of memory now, is it really not able to fit in that?
- jwr 2y agoI guess you are aware of this, but just in case: some of us rely on dictation in our daily computer usage (think people with disabilities or pain problems). A MacBook Pro with M4 Max and 64GB of RAM could easily run something much larger than Whisper Large (around 3GB). I would love a larger, better Whisper for use in the MacWhisper dictation app.