10 ms·
Google Imagen 2
- simonw 3y agoThis post has more information: https://cloud.google.com/blog/products/ai-machine-learning/imagen-2-on-vertex-ai-is-now-generally-available https://cloud.google.com/blog/products/ai-machine-learning/i... I can't figure out how to try this thing. The closest I got was this sentence: "To get started with Imagen 2 on Vertex AI, find our documentation or reach out to your Google Cloud account representative to join the Trusted Tester Program."
- coder543 3y agoThis page might be somewhat helpful: https://cloud.google.com/vertex-ai/docs/generative-ai/image/overview#feature-launch-stage https://cloud.google.com/vertex-ai/docs/generative-ai/image/... It also includes a link to the TTP form, although the form itself seems to make no reference to Imagen being part of the program anymore, confusingly. (Instead indicating that Imagen is GA.)
- a1o 3y ago> GA. Generally Available?
- asimpletune 3y agoYes
- gpm 3y agoI think the process is 1. Go to console.cloud.google.com 2. Go to model garden 3. Search imagegeneration 4. End up at https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/imagegeneration?project=YOUR_PROJECT_ID https://console.cloud.google.com/vertex-ai/publishers/google... And for whatever reason that is where the documentation is. Sample request curl -X POST \ -H "Authorization: Bearer $(gcloud auth print-access-token)" \ -H "Content-Type: application/json; charset=utf-8" \ -d @request.json \ "https://us-central1-aiplatform.googleapis.com/v1/projects/PROJECT_ID/locations/us-central1/publishers/google/models/imagegeneration@002:predict" Sample request.json { "instances": [ { "prompt": "TEXT_PROMPT" } ], "parameters": { "sampleCount": IMAGE_COUNT } } Sample response { "predictions": [ { "bytesBase64Encoded": "BASE64_IMG_BYTES", "mimeType": "image/png" }, { "mimeType": "image/png", "bytesBase64Encoded": "BASE64_IMG_BYTES" } ], "deployedModelId": "DEPLOYED_MODEL_ID", "model": "projects/PROJECT_ID/locations/us-central1/models/MODEL_ID", "modelDisplayName": "MODEL_DISPLAYNAME", "modelVersionId": "1" } Disclaimer: Haven't actually tried sending a request...
- kossTKR 3y agoThis is giving me ptsd flashbacks from working with gCloud from weird "console" pages hidden deep in some yggdrasil sized tree structure with undocumented apis and labyrinthian authentication processes unknown to everyone even Google themselves.
- 6gvONxR4sf7o 3y agoOnce I finally got mostly set up for that, with billing and everything, it said it's only available for a limited number of customers, with a "request access" link to a google form with further links (to enable https://aiplatform.googleapis.com/ https://aiplatform.googleapis.com/) which 404. What a shitshow.
- behnamoh 3y agoGoogle seems to be desperately trying to show that they’re still relevant in AI, but they always end up with half-assed demos and presentations of products that don’t exist yet.
- KennyBlanken 3y agoIsn't "half assed" a fairly accurate description of basically every google product since gmail and Android (and arguably that's been a rolling dumpster fire) Even calendaring was something that took ages for them to get right. For something like a decade you couldn't move an event from one calendar to another on Android - only via the destop web view. Google went from being an innovative company to a web version of IBM...a giant lumbering dinosaur that can't get out of its own way, and everyone kinda needs but also deeply loathes
- Grazester 3y agoHow has Android been a dumpster fire? I don't even think it's arguable.
- ShamelessC 3y ago
- brianjking 3y agoThey've been emailing me saying I have access for quite some time as part of the Trusted Tester program., yet, I still do not. I can caption images but nothing else. So disappointed.
- htrp 3y ago"To get started with Imagen 2 on Vertex AI, find our documentation or reach out to your Google Cloud account representative to join the Trusted Tester Program." And also be prepared to wait somewhere between 6- inf months ... at this point the google cloud account reps can't even grease the wheels for us
- krzyk 3y agoSo it is "Generally" Available.
- dang 3y agoOk, we'll change to that from https://deepmind.google/technologies/imagen-2/ https://deepmind.google/technologies/imagen-2/ above. Thanks!
- JAlexoid 3y agoThe post actually says that it's only for approved users only. >> generally available for Vertex AI customers on the allowlist (i.e., approved for access).
- HlessClaudesman 3y agoGoogle, save the marketing fluff, just let us play with the toys.
- kossTKR 3y agoYeah seriously this is a joke by now. Good research, but product wise they are like the slowest behemoth, impossible to contact, extremely convoluted in their communication and their interfaces like a kafkaesque maze. Open AI really shows us how it's done, or the way Mistral just dumps a torrent on everyone. That's marketing i can respect.
- apsec112 3y agoThis would have been an epic release two years ago, but there are now many well-established models in this area (DALL-E, Midjourney, Stable Diffusion). It would be great to see some comparisons or benchmarks to show Imagen 2 is a better alternative. As it stands, it's hard for me to tell if this is worth switching to.
- larodi 3y agoI was going to pretty much state the same - the obvious, while also adding insult to injury by saying that with recent announces in the lats few weeks, it seems that Google desperately needs to shine in the world of AI, but fails to do so (despite 2000+ votes for new Bard, which is still not so good). Now, from a designer perspective, honestly, I don't care too much who's the provider of the image, since one will have to anyway work more on it. So designers, illustrators, etc are not the target for such platforms, even though it seems counter-intuitive. If you ask me which system was the source for an image used for a poster last 12 months... well, I may remember, but is not of a paramount importance to the end result. After an year of active usage of DALLE2/3, SDXL, Midjourney (which is also SD of some sort) I can confidently state that there is much more work to do and a lot of prompting, to actually get something unique and something worth being used. Sadly the time taken is proportionate to working with actual real artist. Of course - the latter is likely to be hit by this new innovation, but perhaps not so much. From the perspective of s.o. integrating text-ot-image - which is yet to be seen in a reasonable manner, like for a quest game with generative images - the API flexibility and cost would be the most important qualifier. Even then it may actually be better to run SD/XL. From cost perspective - all these services are still very pricey to be used for anything more serious than few one-shot images.
- chankstein38 3y agoRight? This page looks like basically every other generative image AI announcement page as well as basically every model page. They show a bunch of their cherry-picked examples that are still only like "pretty good" (relative to the rest of the industry, it's incredible tech compared to something like deepdream) and give you nothing to really differentiate it.
- Mashimo 3y ago
- deleted 3y ago[deleted]
- ChildOfChaos 3y agoBut how do we use it? Yet another documentation release by googling, promising impressive things that we cannot actually use, while the competition is readily available.
- ilaksh 3y agoIt says we can use it with their API. Would be good to have a link to it though.
- borg16 3y agoI still cannot believe they missed one of the most critical parts of this release - clear and simple instructions on how to use it. How do they even hope to get adoption without that is unclear to me.
- freediver 3y agoGoogle desperately needs to get their platform/docs in order. It is incredibly difficult to use any of their new AI stuff. I have access to Imagen (which was a rodeo to get on its own), but do not know if it v1 or v2 for example.
- Workaccount2 3y agoThey need to ditch Sundar, I don't know what the hell they are thinking. Google so badly needs reorganization.
- wildrhythms 3y agoWhy? The stock has consistently risen since Sundar was hired. So all is well! /s
- smallerfish 3y ago$
- aabhay 3y agoTo all the people saying “this sucks because we can’t use it” — there’s no real value in Google releasing this vs just making the announcement. This space is a race to the bottom, and there’s no significant profit being created in image gen right now (even if the service generates cashflow, the training and inference cost is insane). For the sake of team morale and legal risk, this announcement is totally enough, better to keep training models and focus on the next announcement…
- a1o 3y agoThere's no actual way to use this.
- corv 3y ago[flagged]
- fooker 3y agoWow, Google has really become the IBM of 2005s. All flashy demos, 'call sales' to try anything.
- fullsend 3y agoAccording to Fiona Cicconi, Google’s chief people officer, Google employed 30,000 managers before the recent layoffs. The hard truth is Google needs a Twitter style culling. Take all those billions you're burning and give it to people with a builder mentality, not career sheeple. Unfortunately the same executives who would oversee this are the ones who need to be culled first.
- fooker 3y agoFrom what I understand, Google has a unusually large number of engineers who are happy to coast, and would actively avoid taking on anything important. That seems more of an issue to me compared to middle management bloat.
- bmoxb 3y agoI've seen this claim thrown around a few times but haven't really seen any evidence that it's true, beyond a few unconvincing anecdotes.
- johnfn 3y agoHow come you're readily willing to accept that managers will coast, but not that engineers will coast?
- kossTKR 3y agoPersonally i've found engineering / designer types, including myself, often a bit on various adhd/autism like spectrums with tendencies to overwork, hyperfocus and in general "attach themselves very much to some domain", not that this is always a good thing. I've met many from the managerial class without these traits that seem to have no problem coasting and trancending actual meticulous work because their game is all about personal career management, not the hyperfocus a lot of us here engage in daily.
- l33tman 3y agoThey never released Imagen 1 either, why do they even do these "releases"?
- kkkkkkk 3y agothe post says its generally available and includes instructions on how to use it via their API
- mkl 3y agoThe documentation [1] says otherwise. Image generation is "Restricted General Availability (approved users)" and "To request access to use this Imagen feature, contact your Google account representative." [1] https://cloud.google.com/vertex-ai/docs/generative-ai/image/overview https://cloud.google.com/vertex-ai/docs/generative-ai/image/...
- maizecob 3y ago[dead]
- SpaceManNabs 3y agois there an arxiv paper on how they went from 1 to 2? or any other details?
- dissident_coder 3y agoI love being Canadian - "Not Available in Canada Due To Regulatory Uncertainty"
- tomComb 3y agoTranslation is that the government engaged in a shakedown of Google, on behalf of Bell and Rogers: Bill c-18. It was disgusting and corrupt and I’m glad that Google and Facebook pushed back. This has recently been resolved though, with a compromised deal, so hopefully these services will soon be available here
- ravetcofx 3y agoExcept they just came to an agreement https://www.theglobeandmail.com/politics/article-bill-c18-online-news-google-deal/ https://www.theglobeandmail.com/politics/article-bill-c18-on...
- dissident_coder 3y agoUnfortunately Google caved and are giving away 100 million dollars. I wish they had a spine like Meta. I generally despise both companies (Meta more than Google) but the enemy of my enemy can be my friend at arm's length.
- tomComb 3y agoThe amount and terms agreed upon are what Google originally offerred, so I've mostly seen it reported as the gov't caving. But I still agree with you - would rather have seen Google not give in to this sort of thing at all. It was very different for Meta - they already don't like sending people away from their site so it was much easier for them to hold out.
- martin_drapeau 3y agoSame here. Nothing AI related from Google is available in Canada. This sucks. To add insult to injury, they have nice press releases and demos of their latest AI but aren't easily accessible or available until next year. The press and Wallstreet love gob it up and the stock rises. Is it just for them?
- GaggiX 3y agoWithout a paper about the architecture or the training setup, these announcements are particularly boring. I was hoping to see some research development but nothing.
- rvnx 3y agoA potentially good summary: "We tried to clone Stable Diffusion except we used more GPUs in the process. However the dataset is so heavily censored that the results are disappointing."
- knodi123 3y agoThe prompt "A shot of a 32-year-old female, up and coming conservationist in a jungle; athletic with short, curly hair and a warm smile" produced an impressive image. But I ran the same prompt 3 times on my laptop in just a few minutes, and got 3 almost-equally impressive images. (using stable diffusion and a free model called devlishphotorealism_sdxl15) https://imgur.com/a/4otrN17 https://imgur.com/a/4otrN17
- qingcharles 3y agoI agree, yours are practically identical in quality.
- deleted 3y ago[deleted]
- celestialcheese 3y agoHow are two completely different models from different groups, converging on what looks like the exact same person? Number 1 and 3 are eerily similar. I don't understand.
- passion__desire 3y agohttps://nonint.com/2023/06/10/the-it-in-ai-models-is-the-dataset/ https://nonint.com/2023/06/10/the-it-in-ai-models-is-the-dat...
- isoprophlex 3y agoThat's an incredibly interesting observation. Thanks for sharing.
- jeffbee 3y agoIt's because the only thing these models can do is rip off existing images, and the prompt is very specific. "Generative AI" is a learned, lossy compression codec. You should not be surprised that the range of outputs for a given input seems limited.
- verdverm 3y agoFor the peer comments - https://cloud.google.com/vertex-ai https://cloud.google.com/vertex-ai (marketing page) - https://cloud.google.com/vertex-ai/docs https://cloud.google.com/vertex-ai/docs (docs entry point) - https://console.cloud.google.com/vertex-ai https://console.cloud.google.com/vertex-ai (cloud console) - https://console.cloud.google.com/vertex-ai/model-garden https://console.cloud.google.com/vertex-ai/model-garden (all the models) - https://console.cloud.google.com/vertex-ai/generative https://console.cloud.google.com/vertex-ai/generative (studio / playground) VertexAI is the umbrella for all of the Google models available through their cloud platform. It still seems there is confusion (at google) about this being TTP or GA. Docs say both, the studio has a request access link. more... this page has a table with features and current access levels: https://cloud.google.com/vertex-ai/docs/generative-ai/image/overview https://cloud.google.com/vertex-ai/docs/generative-ai/image/... Seems that some features are GA while others are still in early access, in particular image generation is still EA, or what they call "Restricted GA"
- datadrivenangel 3y agoWhy do Google and Amazon overload their data science notebook offerings with a lot of half-baked poorly documented models and features? Is this just an end-run around incompetent security teams or something?
- verdverm 3y agoI'm not sure what you mean. VertexAI is a product in the larger Google Cloud portfolio. It makes sense that they house everything together instead of making disparate platforms for each. This makes authnz consistent for me and simplifies their end too. In addition to the models, you'll find a host of day-2 features like model monitoring and experiment tracking. Having to vet and pick from 100+ new SaaS's for these is a nice to not have problem.
- deleted 3y ago[deleted]
- brrrrrm 3y agothey should make it accessible at https://imagen.google https://imagen.google like how meta did with https://imagine.meta.com https://imagine.meta.com
- qingcharles 3y agoMeta's one is a really good try. I've used it recently for a lot of stuff. It has way less censorship than DALLE3 via GPT Pro. I did eventually get banned for trying to make too many funny horror pics though.
- CobrastanJorji 3y agoDon't forget Bing Image Creator: https://www.bing.com/images/create https://www.bing.com/images/create My kids found it organically and were happily creating all sorts of DALL·E 3 images.
- timeon 3y agoStrange dark pattern. Both have prompts without submit button.
- rough-sea 3y agoThe authors of the original Imagen paper have gone on to create https://ideogram.ai/ https://ideogram.ai/
- arthurdenture 3y agoI asked imagen 2 to generate a transparent product icon image, and it generated an actual grey and white square pattern as the background of the image... https://imgur.com/a/KA2yWHp https://imgur.com/a/KA2yWHp
- zirgs 3y agoThat's because it was trained on RGB images without an alpha channel. There is currently no public image generator that understands alpha channel.
- wildrhythms 3y agoThe closest I've found is vector generative AI like what's in Adobe Illustrator today.
- RobinL 3y agoAs a user, this really frustrates me. Promoting is not precise enough to compose a bunch of specific elements, so the obvious solution is to do several prompts each with transparency and then combine in Photoshop/photopea. I end up asking for a white background and then cutting out manually
- ianbicking 3y agoI feel like someone could satisfy this issue with a little background removal AI in the pipeline. I also go through the same process, stitching together a few tools, and obviously it's possible... but it sure would be nice if it all fit together better. Something where "transparent background" was translated to "white background" or something and then it went through the background removal.
- zamadatix 3y agoLike the other commenter said, these models aren't trained against images with an alpha channel. Given the same sized model that'd make typical results worse to benefit a niche case. You should be able to have them generate this style image on a background you can color key out though.
- epups 3y agoGoogle became so much of an ad company that they now confuse advertisement with actual product launches.
- tkiolp4 3y agoI hate that you need a Google account to use it. I generally don’t mind creating yet another account on the internet since one can easily create such accounts with temp. email addresses, for example; but with Google is trickier (sometimes they even ask a mobile phone number and all when signing up), and I prefer not to have a dummy google account which I use alongside my real google account for fear of being locked out (e.g., google may think “this guy has two accounts, same computer same ip… let’s ban him”)
- deleted 3y ago[deleted]
- airstrike 3y ago> (e.g., google may think “this guy has two accounts, same computer same ip… let’s ban him”) FWIW I think I have 5+ google accounts. Have had them since gmail was in beta and have never been banned
- modeless 3y agoI don't see any examples of the things existing models really struggle with, like text or counting things.
- herval 3y agothere's literally a full section on that page called "Text rendering support" (with examples)
- modeless 3y agoThe link was changed since I posted my comment, and it's been two hours so I can no longer edit or delete my no-longer-relevant comment. Glad to see the text examples in this link.
- gigel82 3y agoConsidering Google was caught faking stuff during the recent Gemini introduction, I'll take this with a big grain of salt, doubly so considering they don't have a way for people to try it out.
- pphysch 3y agoName a corporation that hasn't embellished their corporate tech demos.
- rvnx 3y agoOpenAI
- pphysch 3y agoFrom their last product release: > As always, you are in control of your data with ChatGPT. Which is a flat-out lie. You can allegedly opt-out of them using your data for training, but you are still sending your data to a private corporation for processing/etc. which makes it totally unsuitable for handling sensitive or restricted data.
- rvnx 3y agoFair enough.
- cubefox 3y agoFor the first Imagen (and for Parti) they released detailed papers. Now they do not even release benchmark results. A shame.
- boh 3y agoI think the competition for text to image services is over and open source, stable diffusion won. It doesn't matter how detailed (or whatever counts as "better") corporate text-to-image products get, stable diffusion is good enough which really is good enough. Unlike the corporate offerings, open source txt2img doesn't have random restrictions (no its not just porn at this point) and actually allows for additional scripts/tooling/models. If you're attempting to do anything on a professional level or produce an image with specific details via txt2img, you likely have a workflow with txt2img being only step one. Why bother using a product from a company that is notorious for failing to commit to most of their services, when you can run something which produces output that is pretty close (and maybe better) and is free to run and change and train?
- herval 3y agoI also think it's over, but I don't see how Stable Diffusion won anything. If something, I see people flocking en masse to dalle3/google/amazon/whatever API is easy to integrate in one side, and consumers paying for Adobe & Canva in the other. Stable Diffusion is the Linux-on-the-desktop of diffusion models IMO (I agree w/ your comment on trusting Google - pretty sure they'll just phase this off eventually anyway, so I wouldn't bother trying it)
- boh 3y agoI don't think there's numbers that show "people flocking" to paid vs free open source offerings since running your own stable diffusion server/desktop isn't showing up on a sale's report. Linux entered the market at a time when paid alternatives were fully established and concentrated, servicing users/companies for years who became used to working with them. No paid txt2img offering comes anywhere close to market dominance for image generation. They don't offer anything that isn't available with free alternatives (they actually offer less) and are highly restrictive in comparison. Anyone who is doing anything beyond disguised DALLE/Imagen clients, has absolutely no incentives to use a paid service.
- bbor 3y agoI would totally agree. I’ve tried to setup stable diffusion a couple times, and even as a professional software engineer working in AI, every time I fail to get good results, get interrupted, lose track, and end up back at DALLE. I’ve seen what it can do, I know it can be amazing, but like Linux it has some serious usability issues
- brettgo1 3y agoI don't really care about these product images. The real test is whether it can produce pictures of hands with five fingers.
- gollum999 3y agoAllegedly Imagen 2 is indeed better at producing hands: https://deepmind.google/technologies/imagen-2/ https://deepmind.google/technologies/imagen-2/ > Imagen 2’s dataset and model advances have delivered improvements in many of the areas that text-to-image tools often struggle with, including rendering realistic hands and human faces and keeping images free of distracting visual artifacts.
- EvgeniyZh 3y agoI've tried and it's genuinely bad, with obvious artifacts. I'm surprised it got released
- mkl 3y agoCan you throw some examples up on Imgur or something?
- EvgeniyZh 3y agoSure, here's sample query https://imgur.com/a/8UDDac9 https://imgur.com/a/8UDDac9 These are DALL-E 3, Imagen, and Imagen 2, in this order. I've used the code based on similar examples from GitHub [1]. According to docs [2], imagegeneration@005 was released on the 11th, so I guessed it's Imagen 2, though there are no confirmations. [1] https://github.com/GoogleCloudPlatform/generative-ai/blob/main/vision/getting-started/visual_captioning.ipynb https://github.com/GoogleCloudPlatform/generative-ai/blob/ma... [2] https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/imagegeneration?hl=en&project=gen-ai-playground-407315 https://console.cloud.google.com/vertex-ai/publishers/google...
- kossTKR 3y agoYou've got to be kidding me. This almost deserves its own post. That last picture is still so horribly bad it's no wonder Google made it almost impossible to access this tech. How did Google drop the ball on AI like this when they pioneered the entire field?
- EvgeniyZh 3y agoTo be fair, it is not always that awful. Here is a sample of the results of simpler subset prompts I like to run on image generation: https://imgur.com/a/aO5S7yM https://imgur.com/a/aO5S7yM Some are bad (first two), but others are okay; it understands text pretty well, but the artifacts just feel like years ago. I still can't understand how it got released and advertized.
- Jackson__ 3y agoKinda scratching my head at the purpose of the prompt understanding examples they show off. From previous papers I've seen in the space, shouldn't they be trying various compositional things like "A blue cube next to a red sphere" and variations thereof? Instead they use >The robin flew from his swinging spray of ivy on to the top of the wall and he opened his beak and sang a loud, lovely trill, merely to show off. Nothing in the world is quite as adorably lovely as a robin when he shows off - and they are nearly always doing it. And show off the result being a photograph of a robin, cool. SDXL[0] can do the exact same thing given the same prompt, in fact even SD1.5 would be able to easily[1]. [0]https://i.imgur.com/rsgtYbf.png https://i.imgur.com/rsgtYbf.png [1]https://i.imgur.com/1rcQpcQ.png https://i.imgur.com/1rcQpcQ.png
- riskable 3y agoI've developed two tests for AI image generators to see if they've actually advanced to "the next level". Take literally any AI image generator and give it one of these prompts: "A flying squirrel gliding between trees": It won't be able to do it. Just telling it "flying squirrel" will often generate squirrels with bat wings coming off their backs. Ahh, but that's just a tiny, specific thing missing from the data set! Surely that'll get fixed eventually as they add more training data... "A fox girl hugging a bunny girl hugging a cat girl": The only way to make this work is with fancy stuff like Segment Anything (SAM) working with Stable Diffusion. Alternative prompts of the same thing: "A fox girl and a bunny girl and a cat girl all hugging each other" It's such a simple thing; generative AI can make three people hugging each other no problem. However, trying to get it to generate three different types of people in the same scene is really, really hard and largely dependent on luck.
- SushiHippie 3y agoI tested the prompts with dalle-3 (through the API) The flying squirrel one, was spot on, it showed an image of the trees, and a squirrel with wings, which kind of looned like bat wings. The 3 girls hugging each other however worked fairly well, it always created 3 different types of persons, but they never hugged each other. Either two of these 3 hugged each other, or no one hugged someone.
- dvh 3y ago[flagged]
- DrSiemer 3y agoSo far the only new thing I'm seeing is the ability to handle text. Didn't Nvidia announce a model that could do that months ago?
- jdlyga 3y agoGoogle needs to update their playbook. A publicly available demo goes a long way. Google of all companies shouldn't be coming off as the dinosaur when it comes to generative AI.
- deleted 3y ago[deleted]