4 ms·
By caveats do you mean the licensing terms or the difficulty of prompting the model? Unless it's relicensed I don't expect LLaMA to be a long-term foundation m
by simonw 4y ago
By caveats do you mean the licensing terms or the difficulty of prompting the model?
Unless it's relicensed I don't expect LLaMA to be a long-term foundation model. But it's shown that yes, you can run a GPT-3 class model on an M1 Mac with 8GB of RAM (or maybe 16GB for the 13B one?)
I fully expect other models to follow, from other organizations, with better capabilities and more friendly licensing terms.
- zamnos 4y agoBut is anyone actually making money off of StableDiffusion? Maybe the shovel-sellers (runpod.io et al), but afaik no one using it as the foundation for a revenue generating company. I ask, because yes, technically, you can't get LLaMA legally unless you're a researcher and get it directly from Facebook. But that's not going to stop the faithful from finding a copy and working on it.
- logifail 4y ago> is anyone actually making money off of StableDiffusion? We're all still waiting to hear about (non-shovel-selling) successes in this space.
- pmoriarty 4y agoI don't know about Stable Diffusion in particular, but three examples of AI-generated art making money immediately spring to mind: 1 - some guy won hundreds of dollars in an art contest from AI generated art (and this made big news, so it should be easy to find) 2 - one person reported using midjourney's images as a starting point for images that wound up being used in a physical magazine 3 - another artist has used midjourney images that they modify to sell in all sorts of contexts (like background images on stock illustration sites) You'd probably find many other examples in midjourney's #in-the-world discord channel. I'd also be shocked if stock image sites, clipart sites and freelance design/illustration sites weren't already flooded with AI generated images that have been sold for money. That being said, because high questly AI-generated images are so easy to make, the value of images of all types is likely to plummet soon if it hasn't already.
- dragonwriter 4y ago> the value of images of all types is likely to plummet soon if it hasn't already. The price might, but the marginal value having them or not has to other products which incorporate them likely won’t as much. So, say, if you are a TTRPG publisher, the value of art to your business doesn't change, but the cost of moving farther along the no art -> scattered sketches & tangentially relevant public domain works -> ideal quantity of art, specific to the product, goes down. So, you are, in effect, making money on SD.
- dragonwriter 4y agoUltimately, its an art tool — a shovel — ecosystem that is democratized enough that it is dominated by high-quality, end-user usable components. Making money with it in the non-shovel-selling sense is going to be commercial artists (or other people with visual image needs, perhaps avoiding the need for commercial artists) incorporating it in production workflows. But except when they are also selling shovels (e.g., Pixar with Renderman) there’s not a whole lot of incentive to trumpet workflow components rather than product in that space.
- logifail 4y ago> commercial artists (or other people with visual image needs, perhaps avoiding the need for commercial artists) incorporating it in production workflows Maybe it's just me, but that reeks of the archetypal race to the bottom. "We didn't have to pay professional X to do task Y as we and others have been doing for decades, instead we used modern replacement Z funded by cheap money which costs peanuts at present". Q: Is there really a business to be made selling Z?
- dragonwriter 4y agoWho cares? If Z is effectively free, and there are businesses to be enhanced using Z, then people are making money with Z, even if the mechanism isn’t “selling Z.” (Of course, yes, if there are businesses to be enhanced with Z, even if Z is free in the sense that open source software is free – which is exactly or approximately the case with much of the Stable Diffusion ecosystem – there will be businesses also to be made “selling” Z, or, more accurately, selling specialized services relating to Z like bespoke enhancements, support, hosting, and training. But those are very much the selling-shovels services that the question upthread asked to exclude; the using-shovels businesses are actually producing products incorporating images.)
- simonw 4y agoI believe Midjourney may have used bits of Stable Diffusion in their product, which is definitely profitable.
- nomdep 4y ago> But is anyone actually making money off of StableDiffusion? How about: - https://www.deepagency.com/ https://www.deepagency.com/ - https://avatarai.me/ https://avatarai.me/
- blueblimp 4y agoNovelAI's image generation uses a fine-tune of Stable Diffusion.
- vintermann 4y agoIf anyone is making net money on Stable Diffusion already, they're either small scale or not going to be around for long, probably both. Anything in it for the longer term is going to be in the buildup phase.
- minimaxir 4y agoIgnoring the licensing issues, there are a few other constraints that would make the model harder to go viral outside of developers who spend a lot of time in this space already: 1) Model weights are heavy for just experimentation, although quantizing it down to 4-bit might make them on par with SD FP16. 2) Requires extreme CLI shenanigans (and likely configuration since you have to run make) compared to just running a Colab Notebook or a .bat Windows Installer for the A1111 UI. 3) Again hardware: a M1 Pro or a RTX 4090 is not super common among people who are just curious about text generation. 4) It is possible the extreme quantization could be affecting text output quality; although the examples are coherent for simple queries, more complex GPT-3-esque queries might become relatively incoherent. Particularly with ChatGPT and its cheap API (timely!) out now such that even nontechies have a strong baseline on good output already. The viral moment for SD was that it was easy to use and it was a significant quality leap over VQGAN + CLIP. I was going to say inference speed since that's usually another constraint for new LLMs but given the 61.41 ms/token cited for the 7B model in the repo/your GIF, that seems on par with the inference speed from OPT-6.7B FP16 in transformers on a T4. Some of these caveats are fixable, but even then I don't think LLaMA will have its Stable Diffusion moment.
- simonw 4y agoThe 4-bit quantized models are 4GB for 7B and 8GB for 13B. I'm not too worried about CLI shenanigans, because of what happened with whisper.cpp - it resulted in apps like https://goodsnooze.gumroad.com/l/macwhisper https://goodsnooze.gumroad.com/l/macwhisper - wouldn't be at all surprised to see the same happen with llama.cpp A regular M1 with 8GB of RAM appears to be good enough to run that 7B model. I wonder at what point it will run on an iPhone... the Stable Diffusion model was 4GB when they first released it, and that runs on iOS now after some more optimization tricks. For me though, the "Stable Diffusion" moment isn't necessarily about the LLaMA model itself. It's not licensed for commercial use, so it won't see nearly the same level of things built on top of it. The key moment for me is that I've now personally seen a GPT-3 scale model running on my own personal laptop. I know it can be done! Now I just need to wait for the inevitable openly-licensed, instruction-tuned model that runs on the same hardware. It's that, but also the forthcoming explosion of developer innovation that a local model will unleash. llama.cpp is just the first hint of that.