2 ms·
No need to deploy it publicly. It's 7B, it'll run on a 3090.
by CamperBob2 13d ago
No need to deploy it publicly. It's 7B, it'll run on a 3090.
- KeplerBoy 13d agoYou talked about commercially deploying it. Of course nobody cares what you are doing on your own hardware for fun.
- CamperBob2 13d agoUsually the way the licenses are interpreted, if I run it myself and use it to generate $X million in revenue in my own business, I'm subject to the license. In this case, the license seems to cover any commercial usage at all, which would certainly include self-hosting for internal business purposes. Why even bother demanding such terms? Release the weights or don't release the weights, but this is silly. No one is going to pay them to run or host a 7B static image model.
- nozzlegear 13d agoWhy not? If it's cheap enough, and presuming I had any reason to use an image model, I'd consider paying for it on OpenRouter over hosting it myself.
- finnjohnsen2 12d agoyes, but it uses 17gb VRAM when running a 50 inference steps generation from prompt. Which is more than I expected since a 7B model sounds little.