5 ms·

This implementation popped up on hacker news not too long ago. I got it working on Colab first, and then my own GPU at home. But just barely. Need more memory :

• stavros 4y ago
  Wait, so I can try this on Colab right now?
  • refulgentis 4y ago
    No, something that's been causing a lotta confusion in AI art is people stand up quick implementations generally matching the general description in the paper, but, they're not really investing in training them. Then people see "imagen-pytorch" on GitHub and get confused, either think it's Imagen itself or a suitable replica of it. There's like 3 projects named DallE, and then the 2 real DallEs...frustrating.
    • spullara 4y ago
      It is a suitable replica of it. Just isn't trained.
      • natch 4y ago
        But the training is the thing that would make it suitable.
        • bpiche 4y ago
          I mean, you try training this thing without a warehouse full of GPUs… to me, the algorithm is just as interesting as the model. Perhaps more so.
          • natch 4y ago
            "This thing" has already been trained. Nobody is saying the algorithm is not interesting. Just that "this thing" has not been released.
            • deleted 4y ago
              [deleted]
            • bpiche 4y ago
              Yes, nobody said one way or another. I chose to shine a light on the algorithm. What’s your point?
              • natch 4y ago
                Rather rude to ask it that way. My point is there for you to read, or miss. Up to you.
      • mapt 4y ago
        "I gave you an open implementation of NAND and NOR gates. That's the core of this groundbreaking CPU. Just finish the job!"
    • joshcryer 4y ago
      People are really thirsty to play with this tech, you can't blame them. Just search for dataset creators on Hugging Face. I'd link directly to several of them running but it would just overwhelm the creators. If you want to be in early you'll find them. The beautiful thing is open source is going to make this stuff available for everyone and in very short timeframe. It's crazy how fast it moves.
      • yreg 4y ago
        >The beautiful thing I'm very much looking forward to be able to play with this tech asap. I'm still excited about AIDungeon. However, OpenAI and creators of the other big name models are restricting the access for good reasons and I'm unsure whether it will be a beautiful thing once it's available for everyone…
        • paconbork 4y ago
          Eh, it exists and it's an inevitability that it will eventually be used in terrible ways. OpenAI and Google people just want the CV booster for having created it but want to pretend it's not their fault when it's used to do a racismsexism.
          • bpiche 4y ago
            I agree. Tay is still fresh in a lot of folks’ minds.
• echelon 4y ago
  Are there any large publicly available models, ready to fine tune and deploy, that were trained on massive data sets? I really want to build services with these.
  • bpiche 4y ago
    VQGAN-CLIP
• sailingparrot 4y ago
  The value is in the data and the trained weights, the implementation is not where the bottleneck is in term of reproducing those models. Still great work from the author though, but we most definitely cannot say that imagen is released.