3 ms·
Keep in mind that image transformer models like stable diffusion are generally smaller than language models, so they are easier to fit in wasm space. Also. you
by lxe 4y ago
Keep in mind that image transformer models like stable diffusion are generally smaller than language models, so they are easier to fit in wasm space.
Also. you can finetune llama-7b on a 3090 for about $3 using LoRA.
- bitL 4y agoOnly for images. People want to generate videos next and those models will be likely GPT-sized.
- Metus 4y agoThere is a video model making the rounds on /r/stablediffusion and it is just a tiny bit larger than Stable Diffusion.
- isoprophlex 4y agoYou're not kidding! it's far from perfect, but pretty funny still... https://www.reddit.com/r/StableDiffusion/comments/126xsxu/nightmare_continues_octopus_dinner https://www.reddit.com/r/StableDiffusion/comments/126xsxu/ni... Too bad SD learned the Shutterstock watermark so well, lol
- bitL 4y agoIt's cool though not very stable in details over temporal axis.
- Metus 4y agoOf course the quality is horrible relative to a proper video, it just illustrates that txt2vid might not need 100B+ parameters.
- danielbln 4y agoGenerative image models don't use transformers, they're diffusion models. LLMs are transformers.