5 ms·
Probably only 6 months until we get this in stable diffusion format. Things are about to get nuts and awesome.
by naillo 4y ago
Probably only 6 months until we get this in stable diffusion format. Things are about to get nuts and awesome.
- J5892 4y ago
- naillo 4y agojarvis render a video of nutsome cream spread on a piece of toast 4k HD
- gamegoblin 4y agoEmad (founder of Stability AI) has said they already have video model training underway, as well as text and audio. Exciting times.
- ItsMonkk 4y agoIs this going to end up into a single model, where its trained on text and images and audio and videos and 3d models, and it can do anything to anything depending on what you ask of it? Feels like the cross-training would help yield stronger results.
- minimaxir 4y agoThese diffusion models are using a frozen text encoder (e.g. CLIP for Stable Diffusion, T5 for Imagen), which can be used in other applications. StabilityAI trained a new/better CLIP for the purpose of better Stable Diffusions.
- CuriouslyC 4y agoProbably not. We're actually headed towards many smaller models that call each other, because VRAM is the limiting factor in application, and if the domains aren't totally dependent on each other it's easier to have one model produce bad output, then detect that bad output and feed it into another model that cleans up the problem (like fixing faces in stable diffusion output). The human brain is modularized like this, so I don't think it'll be a limitation.
- deleted 4y ago[deleted]
- rch 4y agoAnd copilot-like code, possibly Q1 2023.
- RosanaAnaDana 4y ago"Generate the code base for an advanced diffusion model that can improve on the code base for an advanced diffusion model"
- danuker 4y agoThe road to Grey Goo is paved with artificial general intelligence.
- TaylorAlexander 4y agoOh no you forgot the important term “but do NOT start turning the universe in to paperclips”.
- moyix 4y agoSalesforce CodeGen (particularly the 16B-multi and 16B-mono models) is pretty good already and can be used with FauxPilot [1] to get an open Copilot-like experience with local compute :) I am also very excited about the upcoming BigCode project though, which is maybe what you're thinking of? Disclaimer: I am naturally biased since I made FauxPilot ;) [1] https://github.com/moyix/fauxpilot https://github.com/moyix/fauxpilot [2] https://www.bigcode-project.org/ https://www.bigcode-project.org/
- m00x 4y agoIsn't Imagen a diffusion model? From the abstract: > We present Imagen Video, a text-conditional video generation system based on a cascade of video diffusion models
- gamegoblin 4y ago"Stable Diffusion" is a particular brand from the company Stability AI that is famously open sourcing all of their models.
- fragmede 4y agoPedantically, Stable Diffusion v1.4 is the one model where weights were open sourced and released. Stable Diffusion v1.5, announced September 8th and live on their API, was to be released in "a week or two" but still has yet to be released to the general public. https://discord.com/channels/1002292111942635562/1002292112739549196/1016524474373394442 https://discord.com/channels/1002292111942635562/10022921127...
- schleck8 4y agoSD 1.2 and 1.3 are open source too
- cercatrova 4y agoEven more pedantically, SD weights are in fact not open source, they're under a source available license.
- zarzavat 4y ago* If weights are copyrightable in your jurisdiction (who knows!)