7 ms·
MobileDiffusion: Rapid text-to-image generation on-device
- fragmede 3y ago[flagged]
- sp332 3y agoI don't suppose there's any way to actually get this?
- SushiHippie 3y agoKind of funny that they show the iphone 15 pro and the Samsung S24 in the comparison chart, but not their own phone the google pixel 8. (I know it will perform worse than both phones)
- geor9e 3y agoPixel marketing touts the NPU chip, which sounds ideal for accelerating a model like this. They might have reasons for leaving it out. Perhaps it's planned to ship with a new model - announcing a new phone in a model paper would be weird. I remember them advertising some Pixel-only photo editing features in the past.
- refulgentis 3y agoIt's great in theory until you have to pierce through several organizational boundaries to actually leverage it. Too sclerotic for it to happen regularly at scale.
- geor9e 3y agoThis is true. Knowing Google, their own blog post is probably the first time anyone 2 steps up the reporting ladder even heard of it.
- causality0 3y agoAll the Pixel AI stuff runs on the cloud anyway. Just try using it in airplane mode.
- dvngnt_ 3y agonot entirely true. translation is done on device
- adamzochowski 3y agoNot entirely true either. If it thinks it has network but it's flakey, it won't translate offline, it will say there is network error and will give you a button to retry. No button to do offline. Additionally, in airplane mode it heavily doesn't want to translate, in my use case I have to go to saved translations as otherwise it won't even let me type what I need to translate.
- kimixa 3y agoI just tried airplane mode on my pixel 7 pro and it seemed to be able to translate from the camera without problems It doesn't seem to do it "live" in the preview without network access, though. And the translation app seemed to get into a bad state and fail to download the language packs without first clearing the data, saying I need to download the pack, but the language list showing it already was. Though I haven't even opened it since I transferred it from my old phone, so if there's some phone-specific stuff going on that might have got messed up.
- numpad0 3y agoPixel 8 / Tensor G3 specifically is rumored to have a performance or heat issue. The scope of that rumored issue is limited to that generation.
- SushiHippie 3y agoMagic eraser in google photos is also on device. (I have not given Google Photos Network permission and don't have google play services installed) The voice recorder transcription is also on device, but I haven't gotten it to work without google play services on GrapheneOS
- _the_inflator 3y agoThere is some truth to it. I don’t see it as a disadvantage, since Google markets services on both devices you mentioned. Hardly anyone will abandon its iPhone in favor of a Pixel just for a Google service. So I think it’s ok what Google did marketing wise.
- minimaxir 3y ago> With superior efficiency in terms of latency and size, MobileDiffusion has the potential to be a very friendly option for mobile deployments given its capability to enable a rapid image generation experience while typing text prompts. And we will ensure any application of this technology will be in-line with Google’s responsible AI practices. So I'm interpreting this that it won't ever get released.
- Legend2440 3y agoI would interpret it as "expect to see this powering some features in the next-generation Pixel".
- jsheard 3y agoWe've already seen this progression - they debuted Magic Eraser as a cloud feature, then with the Pixel 8 they got it running locally on the device. But they also introduced Magic Editor with the Pixel 8, running on the cloud, and the Pixel 9 or 10 will probably run it on-device.
- ollin 3y agoit may turn out more like the imagen timeline 2022-05 - google imagen research paper posted https://news.ycombinator.com/item?id=31484562 https://news.ycombinator.com/item?id=31484562 2022-12 - imagen developers leave google to form ideogram 2023-08 - ideogram ships a version of imagen, free, for anyone who wants to use it https://ideogram.ai/publicly-available https://ideogram.ai/publicly-available 2023-12 - google "imagen 2" is officially "generally available for Vertex AI customers on the allowlist (i.e., approved for access)." https://news.ycombinator.com/item?id=38628417 https://news.ycombinator.com/item?id=38628417
- kccqzy 3y agoI'm interpreting it as they will be adding a layer of safety restrictions. Understandable given the furore of the recent Taylor Swift generated image incident. Everyone needs to do this and probably is already doing this. Search for "ChatGPT lobotomized" and you'll see plenty of complaints about the safety filters added by OpenAI.
- cuuupid 3y agoGoogle has fallen so far. Both Inception and Mobilenet were released openly and changed the entire AI world. Nowadays we just get blog posts about results that were supposedly achieved, an accompanying paper that can’t be reproduced (because of Google’s magical “private datasets”), and some screencaps of a cool application of the tech that is virtually guaranteed to never make it to product.
- minimaxir 3y agoNo one ever filed multimillion dollar lawsuits over Inception and MobileNet. The calculus is different now.
- tussa 3y agoProbably because the actual product is garbage. Remember the Google assistant demo, where it booked a table at a restaurant? That never materialized. Google assistant is just eating crayons today.
- refulgentis 3y agoYeah it did But to your point its not as impressive as it was sold: glorified reverse phone tree. But it is what it was sold as, and it is available.
- inquirerGeneral 3y agoIt did work, I used it myself. A quick search shows others who had my experience. This was late 2019 for me. Here's the first link and the Google post on rolling out in summer 2019: "Google Assistant just made a dinner reservation for me... I knew this was coming... but mind blown!" https://www.reddit.com/r/googlehome/comments/ezv3us/google_assistant_just_made_a_dinner_reservation/ https://www.reddit.com/r/googlehome/comments/ezv3us/google_a... "Now, you can use it on all Pixel phones in 43 U.S. states. All it takes is a few seconds to tell your Assistant where you'd like to go. Just ask the Assistant on your phone, “Book a table for four people at [restaurant name] tomorrow night.” The Assistant will then call the restaurant to see if it can accommodate your request. Once your reservation is successfully made, you’ll receive a notification on your phone, an email update and a calendar invite so you don’t forget." https://blog.google/products/assistant/book-table-google-assistant-across-country-more-devices/ https://blog.google/products/assistant/book-table-google-ass...
- rysertio 3y agoOriginal paper: https://arxiv.org/abs/2311.16567 https://arxiv.org/abs/2311.16567
- ollin 3y agosome points that stood out to me: 1. they made a lot of careful tweaks to the unet network architecture - it seems like they ran many different ablations here ("In total, our endeavor consumes approximately 512 TPUs spanning 30 days"). 2. the model distillation is based on previous UFOGen work from the same team https://arxiv.org/abs/2311.09257 https://arxiv.org/abs/2311.09257 (hence the UFO graphic in the diffusion-gan diagram) 3. they train their own 8-channel latent encoder / decoder ("VAE") from scratch (similar to Meta's Emu paper) instead of using the SD VAEs like many other papers do 4. they use an internal dataset of 150m image/text pairs (roughly the size of laion-highres) 5. they also reran SD training from scratch on this dataset to get their baseline performance
- asimpleusecase 3y agoGoogle may very well be first to create AGI but it will be wrapped in so many “safety” layers that it would effectively be lobotomised. Let’s just hope that a Google AGI never gets to watch A clockwork orange.
- SignalM 3y ago[flagged]
- kelnos 3y agoWhat a sadly narrow definition of the hacker spirit you seem to have. I enjoy reading articles about interesting research, regardless if there's a practical application of it or not. (If you don't like this sort of thing, just flag it and move on. No need to waste comment space with denouncements.)
- subtra3t 3y agoIf you don't like their comment, just flag it and move on. No need to waste comment space with more denouncements.
- spupy 3y agoSo what could be some use cases for this apart from as a toy or for faking photos/art?
- simultsop 3y agoGenerating memes to friends sparing search time. Describing sketches have them on the fly sharing with teams?
- nonrandomstring 3y agoPeople search and remember things visually. Even if they're not consciously aware. So on the Cybershow [0] we decided to jump-in and use AI images as a quick way to visually tag episodes with something meaningful and fun. We did that despite some moral ambivalence/uneasiness around AI "art". For example, give me a "young and exciting Dana Meadows in front of a board of systems theory" I'm not awful at photoshopping things, and sometimes that's the only way to get a specific image one has in mind. But it saves time and lets us concentrate on writing and researching instead. TBH if an artist/illustrator came along and said "Let me do the episode icons even though you can't pay me yet" I'd feel inclined to ask the AI to step aside. [0] https://cybershow.uk/episodes.php https://cybershow.uk/episodes.php
- malka 3y agoAt first it seems nice. Then I realise it is by Google. This will never see the light of day.
- thyrox 3y agoI never upvote any Google's A.I. research articles as most of the time it is: look what we have done, but we will never release anything. OpenAi gets a lot of criticism for being closed, but at least I can play with their api most of the time. What's the point of this if we will never be able to use this?
- rvnx 3y agoCorporate AND personal marketing. AI researchers can make any claim, the risk of getting busted is close to none. Didn't work ? Well dataset was different Didn't work ? Well code was different Can I try your work ? Well it's proprietary / I don't have access / We shutdowned the cluster But the result is guaranteed increase in salary and job opportunities. Since these companies are publicly listed, they are by definition encouraged and encouraging to make grandiose claims in order to make themselves more attractive to investors, and they can blame the individuals if it becomes discovered. My favorite being that Bard (PaLM version) is sentient, but it was too big this time. Imagine a large pharmaceutical company claiming they can cure very important diseases, but the results cannot be independently verified, nor audited. It’s ok in the short-term, but not when you make that claim during few years.
- nuz 3y agoThe point is probably the implication that it'll be pushed to android as a native feature (in the photos app or similar), thus it making sense for investors reading this to put money into google rather than e.g. stability or openai etc. The people writing the article are likely shareholders etc.
- htsh 3y agoDreambooth was kinda great? That said, I agree that I wish there were more done post-research towards products with some of this stuff.
- deleted 3y ago[deleted]
- TruthWillHurt 3y ago[flagged]
- djoldman 3y agohttps://arxiv.org/pdf/2311.16567.pdf https://arxiv.org/pdf/2311.16567.pdf
- whywhywhywhy 3y agoAre like people at Google Research not embarrassed that none of this stuff ever makes it to real life? Google AI internally needs a huge culture change, stop acting like academics making things for academics and start working like developers making products for customers. I'd say in 10 years we'll be looking back and seeing the wasted potential but actually you can look back around 10 years and already see the wasted potential of all the things Google demoed or papered and never shipped.
- unclad5968 3y agoThat's what research is. It's somebody else's job to determine whether or not it would be useful as a product.
- whywhywhywhy 3y agoThat attitude is why they're now behind in the AI race despite a 10 year head start... Stop larping as an academic and actually start working as an employee, you know what they actually are.
- itsTyrion 3y agoI'm tired of this crap