20 ms·
Our next-generation model: Gemini 1.5
- robertlagrant 3y agoSlightly surprisingly I can't get to AI Studio from the UK. It is available in quite a few countries, but not here.
- system2 3y agoLet's hope this lowers the pricing of GPT-4 to GPT3.5 levels. Because of Open AI's ridiculous pricing, we can't use it regularly as it would cost us thousands of dollars per month.
- crakenzak 3y agoTechnical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_... The 1 million token context window + Gemini 1.0 Ultra level performance seems like it’ll unlock a wide range of incredible use cases! HN, what are you going to use/build with this?
- volkk 3y agowas this posted by an AI bot
- crakenzak 3y agoLol nope I’m a normal person. Gimme a captcha and I’ll (hopefully) solve it ;)
- scarmig 3y agoJust gotta make sure the captcha requires a >1M token context length to solve...
- throwaway918274 3y agoHow do we know you're not an AI bot that figured out how to hire someone from fiverr to solve captchas for you?
- mrkstu 3y agoNo, they're just applying their Twitter style engagement strategy to HN for some reason...
- deleted 3y ago[deleted]
- hamburga 3y ago“One of the key differentiators of this model is its incredibly long context capabilities, supporting millions of tokens of multimodal input. The multimodal capabilities of the model means you can interact in sophisticated ways with entire books, very long document collections, codebases of hundreds of thousands of lines across hundreds of files, full movies, entire podcast series, and more.”
- skywhopper 3y agoThis is nice, but it’s hard to judge how nice without knowing more about how much compute and memory is involved in that level of processing. Obviously Google isn’t going to tell us, but without having some idea it’s impossible to judge whether this is an economically sustainable technology on which to start building dependencies in my own business.
- code51 3y agoDear Google, please fix your names and versioning. Gemini Pro, Gemini Ultra... but was 1.0? now upgraded but again Gemini Pro? jumping from 1.0 to 1.5? wait but not Gemini Pro 1.5... Gemini "1.5" Pro What actually happened between 1.0 and 1.5?
- lairv 3y agoThis naming is terrible, if I understand correctly this is the release of Gemini 1.5 Pro, but not Gemini 1.5 Ultra right ?
- goalonetwo 3y agoLooks like the former PM of chat at google found a new job.
- cchance 3y agoHow is that hard to understand? Yes its gemini 1.5 pro, they haven't released ultra or nano, like this isn't rocket science they didnt introduce Gemini 1.5 ProLight or something, lol its the Pro size model's 1.5 version.
- lairv 3y agoThe name of the blog post is "Our next-generation model: Gemini 1.5", how am I supposed to infer from this that it is only the 1.5 pro and not ultra ?
- nkozyra 3y agoTheir inability to name things sensibly has been called out for years and it doesn't look like they care? I'm not sure what the deal is, it has to be a marketing hinderance as every major tech company is trying to claw their way up the AI service mountain. Seems like the first step would be cogent naming.
- i_love_cookies 3y ago[dead]
- freediver 3y agoIt would do Google a lot of service if every such announcement is not met with 'join the waitlist' and 'talk to your vertex ai team'.
- TheFragenTaken 3y agoIt's probably going to be dead/deprecated in a year, so maybe there's a silver lining to how hard it is to get to use the service. I, for one, wouldn't "build with Gemini".
- kkzz99 3y agoIts because they don't want you to actually use it and see how far behind they are compared to other companies. These announcement are meant to placate investors. "See, we are doing a lot of SotA AI too".
- Keyframe 3y agoYou might be right, but other things from Google tell the same story. For example, I recently tried to get ahold of Pixel 8 Pro. Had to import one from UK, and when I did, turns out that new feature of using thermometer on humans isn't available outside of USA. It doesn't even seem that process to certificate it outside of USA is in play. Google and sales/support just aren't a thing like with Apple, as a contrast. Which is a total shame. I know Google is strong, if not strongest in the game of tech, they just need to get their act together and I believe in them succeeding in that, but sales and support was never in their DNA. Not sure if that can be changed. I'm more than happy to transfer my monthly $20 to google from OpenAI, on top of my youtube and google one subscription. It's up to Google to take it.
- baq 3y agoYeah compared to e.g. Apple’s ‘here’s our new iWidget 42 pro, you can buy it now’ it’s at best disappointing.
- apozem 3y agoApple is good about only announcing real products you can buy. They don't do tech demos. It's always, "here's a problem. the new apple watch solves it. here're five other things the watch does. $399."
- alphabetting 3y agoMassive whoa if true from technical report "Studying the limits of Gemini 1.5 Pro's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens" https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_...
- stavros 3y agoUntil I can talk to it, I care exactly zero.
- peterisza 3y agoyou can buy their stock if you think they'll make a lot of money with their tech
- HarHarVeryFunny 3y agoWell that's really the right question .. what can, and will, Google do with this that can move their corporate earnings needle in a meaningful way? Obviously they can sell API access and integrate it into their Google docs suite, as well as their new Project IDX IDE, but do any of these have potential to make a meaningful impact ? It's also not obvious how these huge models will fare against increasingly capable open source ones like Mixtral, perhaps especially since Google are confirming here that MoE is the path forward, which perhaps helps limit how big these models need to be.
- plaidfuji 3y agoIn the long run it could move the needle in enterprise market share of Workspace and GCP. They have a lot of room to grow and IMO have a far superior product to O365/Azure which could be exacerbated by strong AI products. Only problem is this sales cycle can take a decade or more, and Google hasn’t historically been patient or strategic about things like this.
- deleted 3y ago
- ranulo 3y ago> This new generation also delivers a breakthrough in long-context understanding. We’ve been able to significantly increase the amount of information our models can process — running up to 1 million tokens consistently, achieving the longest context window of any large-scale foundation model yet. Sweet, this opens up so many possibilities.
- tsunamifury 3y agoGoogle is like a nervous and insecure engineer — blowing their value by rushing the narrative and releasing too much too confusingly fast.
- sho_hn 3y agoWhen OpenAI raced through 3/3.5/4 it was "this team ships" and excitement. This cargo-cult hate train is getting tiresome. Half the comments on anything Google-related are like this now, and it doesn't add anything to the conversation.
- epiccoleman 3y agoThe difference, though, as someone who really doesn't have a particular dog in this fight, is that I can go use GPT-4 right now, and see for myself whether it's as exciting as the marketing materials say.
- sho_hn 3y agoWhen OpenAI launched GPT-4, API access was initially behind a waitlist. And they released multiple demo stills of LMM capacilities on launch day that for months were in a limited partner program before they became generally available only 7 months later. I also want the shiny immediately when I read about it, but I also know when I am acting entitled and don't go spam comment threads about it. But really, mostly I mean this: It's fine to criticize things, but when half a dozen people have already raised a point in a thread, we don't need more dupes. It really changes signal-to-noise.
- mynameisvlad 3y agoGemini Ultra was announced two months ago. It just launched in the last week. It literally is still the featured post on the AI section of their blog, above this announcement. https://blog.google/technology/ai/ https://blog.google/technology/ai/ There’s “this team ships” and there’s “ok maybe wait until at least a few people have used your product before you change it all”.
- SushiHippie 3y agoDoes this mean gemini ultra 1.0 -> gemini ultra 1.5 is the same as gpt-4 -> gpt-4-turbo?
- hackerlight 3y agoThere's no Gemini Ultra 1.5 yet. Gemini Pro 1.5 is a smaller model than Gemini Ultra 1.0.
- prakhar897 3y agoCan anyone explain how context length is tested? Do they prompt something like: "Remember val="XXXX" .........10M tokens later....... Print val"
- NhanH 3y agoYep, that’s actually a common one
- blovescoffee 3y agoVery simplified There are arrays (matrices) that are length 10M inside the model. It’s difficult to make that array longer because training time explodes.
- halflings 3y agoYep that's pretty much it! That's what they call needle in a haystack. See: https://github.com/gkamradt/LLMTest_NeedleInAHaystack https://github.com/gkamradt/LLMTest_NeedleInAHaystack
- cchance 3y agoyep they hide things throughout the prompt and then ask it about that specific thing, imagine hiding passwords in a giant block of text and then being like, what was bobs password 10 million tokens later. According to this it's remembering with 99% accuracy, which if you think about it is NUTS, can you imagine reading a 22x 1000 page books, and remembering every single word that was said with 100% accuracy lol
- foota 3y agoInterestingly, there's a decent chance I'd remember if there was an out of context passage saying "the password is FooBar". I wonder if it would be better to test with minor edits? E.g., "what color shirt was X wearing when..."
- ambichook 3y agoi feel you would recognise that more as a quirk of how humans think, remember that LLMs think fundamentally differently to you and i. i would be curious about someone making a benchmark like that and using it to compare as an experiment however
- phoe18 3y agoThe branding is very confusing, shouldn't this be Gemini Pro 1.5 since the most capable model is called Ultra 1.0?
- blurbleblurble 3y agoExtremely confusing!
- butler14 3y agoMaybe they use their own generative AI to do their branding
- dkjaudyeqooe 3y agoCan anyone lay out the various models and their features or point to a resource? I asked the free model (whatever that is) and it wasn't very helpful, alterating betweens a sales bot for Ultra and being somewhat confused itself. Edit: apparently it goes 1.0 Pro, 1.0 Ultra, 1.5 Pro, 1.5 Ultra and so on.
- Alifatisk 3y agoHere's the models, https://news.ycombinator.com/item?id=39304270 https://news.ycombinator.com/item?id=39304270 This is about Gemini Pro going from version 1.0 to 1.5, nothing else. Gemini ultra 1.0 is still on version 1.0
- dkjaudyeqooe 3y agoThat isn't right. The Pro/Ultra exists within each version. If you look at the Gemini report it refers to "Gemini 1.5", then refers to "Gemini 1.5 Pro" and "Gemini 1.0 Pro" and "Gemini 1.5 Pro".
- Alifatisk 3y agoOkey, so if I understand this correctly: - Gemini 1.5 is the new version of the model Gemini. - They are at the moment testing it on Gemini Pro and calling it Gemini Pro 1.5 - The testing has shown that Gemini Pro 1.5 is delivering the same quality as Gemini Ultra 1.0 while using less computing power - Gemini Ultra is still using Gemini 1.0 at the moment
- arange 3y agosignup on mobile too big, doesn't fit submit button :\
- guybedo 3y agolooks interesting enough that i wanted to give Gemini a try and join the waitlist. And i thought it would be easy, what a rookie mistake. Looks like "France" isn't on the list of available regions for Ai Studio ? Now i'm trying to use Vertex AI, not even sure what's the difference with Ai Studio, but it seems it's available. So far i've been struggling for 15 minutes through a maze of google cloud pages: console, docs, signups. No end in sight, looks like i won't be able to try it out
- IanCal 3y agoIt's not available outside of a private preview yet. The page says you can use 1.0 ultra in vertex but it's not available to me in the UK. I can't get on the waitlist, because the waitlist link redirects to aistudio and I can't use that. I should stop expecting that I can use literally anything google announces.
- simonw 3y agoI'd love to know how much a 1 million token prompt is likely to cost - both in terms of cash and in terms of raw energy usage.
- bearjaws 3y agoCannot emphasize enough, even with the improvements in context handling I imagine 128k tokens costs as much as 16k tokens did previously. So 1M tokens is going to be astronomical.
- empath-nirvana 3y agoWhen you account for this, you have to consider how much it would cost to have a human perform the same task.
- deleted 3y ago[deleted]
- iamgopal 3y agoAI race is amazing, Nvidia reaping the benefits now, but soon the world.
- foliveira 3y ago>"Gemini 1.5 Pro (...) matches or surpasses Gemini 1.0 Ultra’s state-of-the-art performance across a broad set of benchmarks." So Pro is better than Ultra, but only if the version numbers are higher?
- denysvitali 3y agoYes, but you'd have to wait for Gemini Pro Max next year to see the real improvements
- renewiltord 3y agoIsn't that usually the case with many products? Like the M3 Pro CPU in the new Macs is more powerful than the M1 Max in the old Macs. The Nano < Pro < Ultra is an in-revision thing. For their LLMs it's a size thing. Then there's newer releases of Nano, Pro, and Ultra. Some Pro might be better than some older Ultra. A lot of people seem confused about this but it feels so easy to understand that it's confusing to me that anyone could have trouble.
- devindotcom 3y agoApple didn't release the M3 Pro a week after the M1 Max
- renewiltord 3y agoAdam Osborne’s wife was one of my dad’s patients so I’m not unacquainted with the risk of early announcements. But surely they do not prevent comprehension.
- thiago_fm 3y agoI like that they are rushing with this and don't care enough to make it Gemini 2 or even really release it, to me it looks like they are concerned to share progress. Hope they do a good job and once OpenAI releases GPT 5 they are competitive with it with their offerings, it will be better for everyone.
- kaspermarstal 3y agoIncredible. RAG will be obsolete in a year or two.
- hackernoteng 3y agoIt's already obsolete. It doesn't work except for trivial cases which have no real value.
- jeanloolz 3y agoObsolete if you don't take cost in consideration. Having 10 millions of token going through each layer of the LLM is going to cost a lot of money each time. At gpt4 rate that could mean 200 dollars for each inference
- scarmig 3y agoThe technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_...
- jpeter 3y agoOpenAI has no Moat
- jklinger410 3y agoThey only have a head start, and the lead is closing
- seydor 3y agohence why it's Open
- rvz 3y agoThis. He’s right you know. OpenAI is extremely overvalued and Google is closing their lead rapidly.
- fnordpiglet 3y agoIs there any meaningful valuation on OpenAI? It’s not for sale, there is no market. Google … has no ability to commercialize anything. Their only commercial successes are ads and YouTube. Doing deceptive launches and flailing around with Gemini isn’t helping their product prospects. I wouldn’t take a bet between open ai and anyone, but I also wouldn’t take a bet on Google succeeding commercially on anything other than pervasive surveillance and adware.
- rvz 3y ago> Is there any meaningful valuation on OpenAI? It’s not for sale, there is no market. Its shares are already for sale on private markets for accredited investors and for a valuation of over $100BN lead by Thrive Capital. > Google … has no ability to commercialize anything. Absolute nonsense. So Google Cloud, Android (Play Store) are not already commercialized? You well know that they are. > Doing deceptive launches and flailing around with Gemini isn’t helping their product prospects. Gemini already caught up to (and surpassed) GPT-4V. What is your point? > I wouldn’t take a bet between open ai and anyone, but I also wouldn’t take a bet on Google succeeding commercially on anything other than pervasive surveillance and adware. OpenAI's greatest competitor is Google DeepMind which has the advantage of Google's infrastructure to scale up their models quickly and they have direct access to Google's billions. OpenAI cannot afford to make mistakes or delay anything and a single mistake can cost them hundreds of millions of dollars. The majority of the investment from Microsoft is in Azure credits and not in dollars. [0] [0] https://www.semafor.com/article/11/18/2023/openai-has-received-just-a-fraction-of-microsofts-10-billion-investment https://www.semafor.com/article/11/18/2023/openai-has-receiv...
- gpjanik 3y ago0 trust to what they put out until I see it live. After the last "launch" video which was fundamentally a marketing edit not showing the real product, I don't trust anything coming out of Google that isn't an instantly testable input form.
- deleted 3y ago[deleted]
- seaman1921 3y ago[flagged]
- tfsh 3y agoThe videos shown in these demos have clearly learnt from that as they're using a real live product, filmed on their computers with timers in the bottom showing how long the computations take.
- frays 3y agoI completely share the same views as you after their last video - and it appears that they've learnt their lesson this time. If you watch the videos in the blog post, you can see it's a screen recording on a computer without any editing/stitching of different scenes together. It's good to be sceptical but as engineers we should all remain open.
- replwoacause 3y ago100%. Google continues to underwhelm. Not buying it until I can try it.
- dingclancy 3y agoEssentially, the focus seems to be on leveraging the media buzz around Gemini 1.0 by highlighting the development of version 1.5. While GPT-4's position relative to Gemini 1.5 remains unclear, and the specifics of ChatGPT 4.5 are yet to be disclosed, it's worth noting that no official release has taken place until the functionality is directly accessible in user chats. Google appears to be making strides in catching up. When it comes to my personal workflow and accomplishing tasks, I still find ChatGPT to be the most effective tool. My familiarity with its features has made it indispensable. The integration of mentions and tailored GPTs seamlessly enhances my workflow. While Gemini may match the foundational capabilities of LLMs, it falls short in delivering a product that efficiently aids in task completion.
- losvedir 3y agoIf I understand correctly, they're releasing this for Pro but not Ultra, which I think is akin to GPT 3.5 vs 4? Sigh, the naming is confusing... But my main takeaway is the huge context window! Up to a million, with more than 100k tokens right now? Even just GPT 3.5 level prediction with such a huge context window opens up a lot of interesting capabilities. RAG can be super powerful with that much to work with.
- danpalmer 3y agoThe announcement suggests that 1.5 Pro is similar to 1.0 Ultra.
- benopal64 3y agoI am reaching a bit, however, I think its a bit of a marketing technique. The Pro 1.5 being compared to the Ultra 1.0 model seems to imply that they will be releasing a Ultra 1.5 model which will presumably have similar characteristics to the new Pro 1.5 model (MOE architecture w/ a huge context window).
- danpalmer 3y agoApparently the technical report implies that Ultra 1.5 is a step-up again, I'm not sure it's just context length, that seems to be orthogonal in everything I've read so far.
- ygouzerh 3y agoSo Pro and Ultra are from my understanding link to the number of parameters. More parameters means more reasonning capabilities, but more compute needed. So Pro is like the light and fast version and Ultra the advanced and expensive one.
- cchance 3y agoIt's sizes Nano/Pro/Ultra are model SIZES. 1.0/1.5 is generations of the architecture.
- 3y ago
- golergka 3y agoIn one of the demos, it successfully navigates a threejs demo and finds the place to change in response to a request. How long until it shows similar results on middle-sized and large codebases? And do the job adequately?
- kypro 3y ago1-2 years probably. There will still be a question around who determines what "adequately" is for a while though. Presumably even if an LLM can do something in theory you wouldn't actually want it doing anything without human oversight. And we should keep in mind that to understand a code change in depth is often just as much work as making the change. When review PRs I don't really know exactly what every change is doing. I certain haven't tested it to be 100% certain I understand fully. I'm just checking the logic looks mostly right and that I don't see anything clearly wrong, and even then I'll often need to ask for clarifications why something was done. I can't imagine LLMs being used in most large code bases for a while yet. They'd probably need to be 99.9% reliable before we can start trusting them to make changes without verifying every line.
- simon_kun 3y agoToday.
- pryelluw 3y agoGemini (or whatever google ai) will be all about ads. I’m not adopting this shit. Their whole business model is ads. Why would I adopt a product from a company that only cares about selling more ads?
- Alifatisk 3y agoGoogle One's business model is not ads? I mention Google One because you can access Gemini Ultra through it.
- imp0cat 3y agoAll their services are just a way to get more information about their users so they can serve them ads. Those Gemini queries will be no exception.
- sodality2 3y agoNot true - Gemini looks to be marketed towards companies, where it's far more profitable to just charge thousands of dollars. Ads wouldn't fund AI usage anyway. GPU's are extremely expensive (even Google's fancy TPU's).
- imp0cat 3y agoI find that hard to belive. Ads most probably already funded all the research, development and manufacturing required to produce those TPUs. But we'll see, maybe Gemini will become profitable eventually.
- deleted 3y ago[deleted]
- snapcaster 3y agoAgreed, people continually forget that Google has fundamentally failed at everything besides selling ads despite decades of moonshots and other attempts to shift the business. Very skeptical that any company getting 80% revenue from ads will be able to resist the pressure to advertise
- royletron 3y agoIs there a reason this isn't available in the UK/France/Germany/Spain but is in available in Jersey... and Tuvalu?
- vibrolax 3y agoProbably because EU/national governments have regulations with respect to the safety and privacy of the users, and the purveyors must evaluate the performance of their products against the regulatory standards.
- onlyrealcuzzo 3y agoEU regulations and fines.
- seydor 3y agoOnwards to a billion tokens
- fernandotakai 3y agoi saw this announcement on twitter and i was excited to check it out, only to see that "we’re offering a limited preview of 1.5 Pro to developers and enterprise customers via AI Studio and Vertex AI". please google, only announce things when people can actually use it.
- deleted 3y ago[deleted]
- xyzzy_plugh 3y agoI miss when I didn't have to scroll to read a single tweet.
- ComputerGuru 3y agoTwitter has that functionality natively now, but I don't know if you have to be a pro user to access. It's the book icon in the upper-right corner of the first tweet in a series. Links to this, but it looks different when I view it in incognito vs logged in: https://twitter.com/JeffDean/thread/1758146022726041615 https://twitter.com/JeffDean/thread/1758146022726041615
- xyzzy_plugh 3y agoThe functionality I'm talking about is tweets not being walls of text that require scrolling to read. I have no idea what you're describing.
- famouswaffles 3y ago>Finally, we highlight surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person learning from the same content. Results - https://imgur.com/a/qXcVNOM https://imgur.com/a/qXcVNOM From the technical report https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_...
- poulpy123 3y ago> at a similar level to a person learning from the same content. That's an incredibly low bar
- ithkuil 3y agoIt's incredible how fast goalposts are moving. The same feat one year ago would have been almost unbelievable.
- KeplerBoy 3y agoSince when are we expecting super-human capabilities?
- andsoitis 3y agoAnd in fact it already is super human. Show me a single human who can translate amongst 10+ languages across specialized domains in the blink of an eye.
- empath-nirvana 3y agoChat GPT has been super human in a lot of tasks even since 3.5. People point out mistakes it makes that no human would make, but that doesn't negate the super-human performance it has at other tasks -- and the _breadth_ of what it can do is far beyond any single person.
- petargyurov 3y agoVersion number suggests they're waiting to announce something bigger already?
- uptownfunk 3y agoGoogle is a public company. Anything and everything will be scrutinized very heavily by shareholders. Of course how Zuck operates very different than Sindar. What are they doing with their free cash is my question. Are they waiting for the LLM bubble to pop to buy some of these companies at a discount?
- deleted 3y ago[deleted]
- ComputerGuru 3y agoThe context window size - if it really works as advertised - is pretty ground-breaking. It would replace the need to RAG or fine tune for one-off (or few-off) analys{is,es} of input streams cheaper and faster. I wonder how they got past the input token stuffing problems everyone else runs into.
- jcuenod 3y agoIt won't remove the use of RAG at all. That's like saying, "wow, now that I've upgraded my 128GB HDD to 1TB, I'll never run out of space again."
- madisonmay 3y agoIt's more like saying "I've upgraded to 128GB of RAM, I'll never use my disk again".
- sebzim4500 3y ago10 TB for an accurate proportion. And I think people who buy a laptop with a 1TB SSD generally don't run out of space, at least I don't.
- lumost 3y agoThey are almost certainly using some form of sparse attention. If you linearize the attention operation, you can scale up to around 1-10M tokens depending on hardware before hitting memory constraints. Linearization works off the assumption that for a subsequence of X tokens out M tokens, where M os much greater than X there are likely only K tokens which are useful for the attention operation. There are a bunch of techniques to do this, but it's unclear how well any of them scale.
- ein0p 3y agoNot "almost", but certainly. Dense attention is quadratic, not even Google would be able to run it at an acceptable speed. Their model is not recurrent - they did not have the time yet (or resources - believe it or not, Google of 2023-24 is very compute constrained) to train newer SSM or recurrent based models at practical parameter counts. Then there's the fact that those models are far harder to train due to instabilities, which is one of the reasons why you don't yet see FOSS recurrent/SSM models that are SOTA at their size or tokens/sec. With sparse attention, however, long context recall will be far from perfect, and the longer the context the worse the recall. That's better than no recall at all (as in a fully dense attention model which will simply lop off the preceding parts of the conversation), but not by a hell of a lot.
- Alifatisk 3y agoI remember one of the biggest advantages with Google Bard was the heavily limited context window. I am glad Google is now actually delivering some exciting news now with Gemini and this gigantic token size. Sure it's a bummer that they slap the "Join the waiting list", but it's still interesting to read about their progress and competing with ClosedAi (OpenAi). One last thing I hope they fix is the heavily morally and ethically guardrail, sometimes I can barely ask proper questions without it triggering Gemini to educate me about what's right and wrong. And when I try the same prompt with ChatGPT and Bing ai, they happily answer.
- elevatedastalt 3y ago"biggest advantages with Google Bard" Did you mean disadvantages?
- Alifatisk 3y agoYes, thanks.
- CrypticShift 3y agoMost data accumulates gradually (e.g., one email at a time, one line of text at a time across various documents). Is this huge 10M scale of context window relevant to a gradual, yet constant, influx of data (like a prompt over a whole google workspace) ?
- Imnimo 3y agoThis is the first time I've been legitimately impressed by one of Google's LLMs (with the obvious caveat that I'm taking the results reported in their tech report at face value).
- replwoacause 3y agoIt’s just marketing at this point, nothing to be impressed by. It’s a mistake to take at face value.
- sremani 3y agoI have Gemini Advanced, do I get access to this? Google is giving Microsoft run for money for branding confusion.
- Alifatisk 3y agoNot yet, Gemini advanced is using Gemini Ultra, not Gemini pro.
- Ecstatify 3y agoGemini advanced is terrible. I asked it to rephrase "Are the original stated objectives still relevant?" It's starts going on about Ukraine and Russia. https://g.co/gemini/share/ddb3887f79e2 https://g.co/gemini/share/ddb3887f79e2
- Alifatisk 3y agoI think it took the whole context of the converstion into consideration, you should create a new converstaion instead and see if it responds differently. Or you could be more specific, like "Rephrase the following sentence: 'Are the original stated objectives still relevant?' in a formal way, respond with one option only."
- Ecstatify 3y agoIt was a new conversation. I've never mentioned Russia or Ukraine in any conversation ever.
- vessenes 3y agoThe white paper is worth a read. The things that stand out to me are: 1. They don't talk about how they get to 10M token context 2. They don't talk about how they get to 10M token context 3. The 10M context ability wipes out most RAG stack complexity immediately. (I imagine creating caching abilities is going to be important for a lot of long token chatting features now, though). This is going to make things much, much simpler for a lot of use cases. 4. They are pretty clear that 1.5 Pro is better than GPT-4 in general, and therefore we have a new LLM-as-judge leader, which is pretty interesting. 5. It seems like 1.5 Ultra is going to be highly capable. 1.5 Pro is already very very capable. They are running up against very high scores on many tests, and took a minute to call out some tests where they scored badly as mostly returning false negatives. Upshot, 1.5 Pro looks like it should set the bar for a bunch of workflow tasks, if we can ever get our hands on it. I've found 1.0 Ultra to be very capable, if a bit slow. Open models downstream should see a significant uptick in quality using it, which is great. Time to dust out my coding test again, I think, which is: "here is a tarball of a repository. Write a new module that does X". I really want to know how they're getting to 10M context, though. There are some intriguing clues in their results that this isn't just a single ultra-long vector; for instance, their audio and video "needle" tests, which just include inserting an image that says "the magic word is: xxx", or an audio clip that says the same thing, have perfect recall across up to 10M tokens. The text insertion occasionally fails. I'd speculate that this means there is some sort of compression going on; a full video frame with text on it is going to use a lot more tokens than the text needle.
- deleted 3y ago[deleted]
- CharlieDigital 3y ago> The 10M context ability wipes out most RAG stack complexity immediately. Remains to be seen. Large contexts are not always better. For starters, it takes longer to process. But secondly, even with RAG and the large context of GPT4 Turbo, providing it a more relevant and accurate context always yields better output. What you get with RAG is faster response times and more accurate answers by pre-filtering out the noise.
- cubefox 3y agoI think Anthropic and OpenAI could also have offered a one million context window a while ago. The relevant architecture breakthrough was probably when a linear increase in context length only required a linear increase in inference compute instead of a quadratic one. Anthropic and then OpenAI achieved linear context compute scaling before an architecture for it was published publicly (MAMBA paper).
- bearjaws 3y agoThe problem is, the 128k window performed terribly and showed that attention was mostly limited to the first and last 20%. Increasing it to 1M just means even more data is ignored.
- cubefox 3y agoMaybe their architecture wasn't as good as MAMBA and Google could use the better architecture thanks to being late to the game...
- zippothrowaway 3y agoI've always been suspicious of any announcement from Demis Hassabis since way back in his video game days when he did a monthly article in Edge magainze about the game he was developing. "Infinite Polygons" became a running joke in the industry because of his obvious snake-oil. The game itself, Republic [1], was an uninteresting failure. He learned how to promote himself from working for Peter "Project Milo" Molyneux and I see similar patterns of hype. [1] https://en.wikipedia.org/wiki/Republic:_The_Revolution#Marketing https://en.wikipedia.org/wiki/Republic:_The_Revolution#Marke...
- pradn 3y agoThe line between delusional and visionary is thin! I know I'm too grounded in "expected value" math to do super outlier stuff like starting a video game company...
- Qwero 3y agoFunny read about his game. Nonetheless while still underwhelming in comparison to gpt-4 (excluding this announcement as I haven't tried it yet), alpha go, zero and especially fold were tremendous!
- COAGULOPATH 3y agoYeah, it's funny. I used to think "Demis Hassabis...where have I heard that name before?" And then I realized I saw him in the manuals for old Bullfrog games.
- rreichman 3y agoAnd yet - AlphaGo, AlphaZero, AlphaFold...
- obblekk 3y agoVery impressive if the benchmarks replicate. Some questions: * token cost? In multiples of Gemini pro 1 * memory usage? Does already scarce gpu memory become even more of a bottleneck? * video resolution? Sherlock Jr (1924) is their test video - black and white, 45min, low res Most curious about the video… I wonder if RAG within video will become the next battlefront
- deleted 3y ago[deleted]
- technics256 3y agoDoes anyone actually have access to Ultra yet? It's a lame blog post where it says "it's available!" but the fine print says "by whitelist". Ok, whatever that means. OpenAI at least releases it all at once, to everyone.
- Szpadel 3y agooh, openai had a lot of waitlists also, gpt4 API, large context versions etc
- sonium 3y agoI just watched the demo with the Apollo 11 transcript. (sidenote: maybe Gemini is named after the space program?). Wouldn't the transcript or at least a timeline of Apollo 11 be part of the training corpus? So even without the 400 pages in the context window just given the drawing I would assume a prompt like "In the context of Apoll 11, what moment does the drawing refer to?" would yield the same result.
- technics256 3y agoGemini is named that way because of the collaboration between Google brain and deep mind
- singularity2001 3y agoCorrect except that it spits out the timestamp
- torginus 3y agoGemini is named after the spacecraft that put the second person into orbit - pretty aptly named, but not sure if this was the intention.
- DrNosferatu 3y agoGoogle needs their Apollo.
- d0mine 3y agoThe second person was put by MR-3 (Mercury, not Gemini) https://en.m.wikipedia.org/wiki/Timeline_of_space_travel_by_nationality https://en.m.wikipedia.org/wiki/Timeline_of_space_travel_by_...
- empath-nirvana 3y agoi asked chatgpt4 to identify three humorous moments in the apollo 11 transcript and it hallucinated all 3 of them (i think -- i can't find what it's referring to). Presumably it's in it's corpus, too. > The "Snoopy" Moment: During the mission, the crew had a small, black-and-white cartoon Snoopy doll as a semi-official mascot, representing safety and mission success. At one point, Collins joked about "Snoopy" floating into his view in the spacecraft, which was a light moment reflecting the camaraderie and the use of humor to ease the intense focus required for their mission. The "Biohazard" Joke: After the successful moon landing and upon preparing for re-entry into Earth's atmosphere, the crew humorously discussed among themselves the potential of being quarantined back on Earth due to unknown lunar pathogens. They joked about the extensive debriefing they'd have to go through and the possibility of being a biohazard. This was a light-hearted take on the serious precautions NASA was taking to prevent the hypothetical contamination of Earth with lunar microbes. The "Mailbox" Comment: In the midst of their groundbreaking mission, there was an exchange where one of the astronauts joked about expecting to find a mailbox on the Moon, or asking where they should leave a package, playing on the surreal experience of being on the lunar surface, far from the ordinary elements of Earthly life. This comment highlighted the astronauts' ability to find humor in the extraordinary circumstances of their journey.
- htrp 3y ago> Gemini 1.5 delivers dramatically enhanced performance. It represents a step change in our approach, building upon research and engineering innovations across nearly every part of our foundation model development and infrastructure. This includes making Gemini 1.5 more efficient to train and serve, with a new Mixture-of-Experts (MoE) architecture. Looks like they fine tuned across use cases and grabbed the mixtral architecture?
- sebzim4500 3y agoThere's no way that's all it is, scaling mixtral to a context length of 10M while maintaining any level of reasoning ability would be extremely slow. If the only purpose of the model was to produce this report then maybe that's possible, but if they plan on actually deploying this to end users then there is no way they can run quadratic attention on 10M tokens.
- joak 3y ago«We’ll also introduce 1.5 Pro with a standard 128,000 token context window when the model is ready for a wider release» So actually they are lagging: their 128k model is yet to be released while OpenAI released theirs some months ago.
- joak 3y agoTheir 10M tokens demo is impressive though. They "released" a demo. Confusing...
- kyrra 3y agoSee: https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/ https://blog.google/technology/ai/google-gemini-next-generat... > Gemini 1.5 Pro comes with a standard 128,000 token context window. But starting today, a limited group of developers and enterprise customers can try it with a context window of up to 1 million tokens via AI Studio and Vertex AI in private preview.
- joak 3y agoGemini 1.5 Pro is not yet released: «Starting today, we’re offering a limited preview of 1.5 Pro to developers and enterprise customers via AI Studio and Vertex AI» Something like an alpha version. Limited preview in their jargon.
- cubefox 3y agoThe whitepaper says the Buster Keaton film was reduced to 1 FPS before being fed in. Apparently multi-modal language models can only read individual pictures, so videos have to be reduced to a series of frames. I assume animal brains are more efficient than that. E.g. by only feeding the "changes/difference over time" instead of a sequence of time slices.
- riku_iki 3y agoit will probably eventually be improved by adding some encoder on top of LLM, which will encode 60 frames into 1 while attempting to preserve information..
- freedomben 3y ago> Our teams continue pushing the frontiers of our latest models with safety at the core. They're not kidding, Gemini (at least what's currently available) is so safe that it's not all that useful. The "safety" permeates areas where you wouldn't even expect it, like refusing to answer questions about "unsafe" memory management in C. It interjects lectures about safety in answers when you didn't even ask it to do that in the question. For example, I clicked on one of the four example questions that Gemini proposes to help you get started and it was something like "Write an SMS calling in sick. It's a big presentation day and I'm sad to let the team down." Gemini decided to tell me that it can't impersonate positions of trust like medical professionals or employers (which is not at all what I asking it to do). The other things I asked it, it gave me wrong and obviously wrong answers. The funniest (though glad it was obviously wrong) was when I asked it "I'm flying from Karachi to Denver. Will I need to pick up my bags in Newark?" and it told me "no, because Karachi to Newark is a domestic flight" Unless they stop putting "safety at the core," or figure out how to do it in a way that isn't unnecessarily inhibiting, annoying, and frankly insulting (protip: humans don't like to be accused of asking for unethical things, especially when they weren't asking for them. when other humans do that to us, we call that assuming the worst and it's a negative personality trait), any announcements/releases/breakthroughs from Google are going to be a "meh" for me.
- deleted 3y ago[deleted]
- dghlsakjg 3y agoThis is incredible if it isn't just hype! I hope the demos aren't fudged/scripted like Google did with Gemini 1.0
- amf12 3y agoThese demos seem to be videos from AI studio, and which display the time in seconds. Hopefully not fudged.
- EZ-E 3y agoRemember AI Dungeon and how it was frustrating about how it would forget what happened previously? With a 10M context window, am I right to assume it would be possible to weave a story which would span with multiple multiple books worth of content? (more or less 1400 pages)
- dougmwne 3y agoPretty much! Check out this demo of finding a scene in a 1400 page book based on a stick figure drawing. Mind blowing, right? https://twitter.com/JeffDean/status/1758148159942091114 https://twitter.com/JeffDean/status/1758148159942091114
- EZ-E 3y agoIn theory it would be possible to drop a book and just say "hey Google, create a sequel" But I doubt it is /that/ good, it's not like we can test it either
- VikingCoder 3y agoDear Google, Teach Gemini how to be a Dungeon Master, and run free adventures at Comic Con. Then offer it up as a subscription. Sincerely, Everyone
- famouswaffles 3y ago10M tokens is about 25,000 pages. 10M tokens is also never coming to production and is solely research testing. 1M tokens is what they've said will be available for production and is about 2,500 pages.
- eigenvalue 3y agoBased on what I've seen so far, I think the probability that this is actually better than GPT4 on the kind of real world coding tasks that I use it for is less than 1%. Literally everything from Google on this has been vaporware or laughably bad in actual practice in my personal experience. Which is totally insane to me given their financial resources, human resources, and multi-year lead in AI/DL research, but that's what seems to have happened. I certainly hope that they can develop and actually release a capable model, but at this point, I think you have to be deeply skeptical of everything they say until such a model is available for real by the public and you can try it on actual, real tasks and not fake benchmark nonsense and waitlists.
- scarmig 3y agoOne interesting tidbit from the technical report: >HumanEval is an industry standard open-source evaluation benchmark (Chen et al., 2021), but we found controlling for accidental leakage on webpages and open-source code repositories to be a non-trivial task, even with conservative filtering heuristics. An analysis of the test data leakage of Gemini 1.0 Ultra showed that continued pretraining on a dataset containing even a single epoch of the test split for HumanEval boosted scores from 74.4% to 89.0%, highlighting the danger of data contamination. We found that this sharp increase persisted even when examples were embedded in extraneous formats (e.g. JSON, HTML). We invite researchers assessing coding abilities of these models head-to-head to always maintain a small set of truly held-out test functions that are written in-house, thereby minimizing the risk of leakage. The Natural2Code benchmark, which we announced and used in the evaluation of Gemini 1.0 series of models, was created to fill this gap. It follows the exact same format of HumanEval but with a different set of prompts and tests.
- llm_trw 3y agoYeah. I'll believe that when I can use it.
- DidISayTooMuch 3y agoHow can I fine tune these models for my use? Their docs isn't clear whether the Gemini models are fine tuneable.
- qwertox 3y agoAs a sidenote, it's worth clicking the play button and then checking how they're highlighting the current paragraph and word in the inspector.
- aubanel 3y agoFor reference, here is the technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_...
- dumbmachine 3y agoIt would, probably, be cost prohibitive to use 10M context to it's fullest each time. I instead hope for to have an api to access to the context as a datastore, so like RAG we can control what to store but unlike rag all data stays within context.
- killthebuddha 3y ago10M tokens is an absolute game changer, especially if there's no noticeable decay in quality with prompt size. We're going to see things like entire domain specific languages embedded in prompts. IMO people will start thinking of the prompt itself as a sort of runtime rather than a static input. Back when OpenAI still supported raw text completion with text-davinci-003 I spent some time experimenting with tiny prompt-embedded DSLs. The results were very, very, interesting IMO. In a lot of ways, text-davinci-003 with embedded functions still feels to me like the "smartest" language model I've ever interacted with. I'm not sure how close we are to "superintelligence" but for baseline general intelligence we very well could have already made the prerequisite technological breakthroughs.
- empath-nirvana 3y agoIt's pretty slow, though looks like up to 60 seconds for some of the answers, and uses god knows how much compute, so there's probably going to be some trade offs -- you're going to want to make sure that that much context is actually useful for what you want.
- drusepth 3y agoTBF: when talking about the first "superintelligence", I'd expect it to take unreasonable amounts of compute and/or be slow -- that can always be optimized. Bringing it into existence in the first place is the hardest part.
- unshavedyak 3y agoYea. Of course for some tasks we need speed, but i've been kinda surprised that we haven't seen very slow models which perform far better than faster models. We're treading new territory, and everyone seems to make models that are "fast enough". I wanna see how far this tech can scale, regardless of speed. I don't care if it takes 24h to formulate a response. Are there "easy" variables which drastically improve output? I suspect not. I imagine people have tried that. Though i'm still curious as to why.
- Yusefmosiah 3y agoI see a lot of talk about retrieval over long context. Some even think this replaces RAG. I don't care if the model can tell me which page in the book or which code file has a particular concept. RAG already does this. I want the model to notice how a concept is distributed throughout a text, and be able to connect, compare, contrast, synthesize, and understand all the ways that a book touches on a theme, or to rewrite multiple code files in one pass, without introducing bugs. How does Gemini 1.5's reasoning compare to GPT-4? GPT-4 already has superhuman memory; its bottleneck is its relatively weak reasoning.
- sinuhe69 3y agoIn my experience (I work mostly and deeply with Bard/Gemini), the reasoning capability of Gemini is quite good. Gemini Pro is already much better than ChatGPT 3.5, but they still make quite a few mistakes along the way. What is more worrying is that when these models made mistakes, they tried really hard to justify their reasoning (errors), practically misleading the users. Because of their high mimicry ability, users really have to pay attention to validate and eventually spot the errors. Of course, this is still far below the human level, so I'm not sure whether they add value or are more of a burden.
- famouswaffles 3y agoThe most impressive demonstration of long context is this in my opinion, https://imgur.com/a/qXcVNOM https://imgur.com/a/qXcVNOM Testing language translation abilities of an extremely obscure language after passing in one grammar book as context.
- bloopernova 3y agoHooray for competition.
- luke-stanley 3y agoStill no Ultra model API available to UK devs? Considering Deepmind's London base, this is kinda strange. Maybe they could ask Ultra how to roll it out faster?
- bobvanluijt 3y agoDemo with Google AI Studio: https://twitter.com/bobvanluijt/status/1758185143116730875 https://twitter.com/bobvanluijt/status/1758185143116730875
- processing 3y agojust wade through documentation to access it? clicking on the AI studio link doesn't show me the app page - it redirects to a document on early access. I do as required - go back and try clicking on the AI studio link and I'm redirected to the document on turning early access. frustrating.
- ChildOfChaos 3y agoIs this just more nonsense from Google though? I expect big things from Google, but they need to shut up and actually release stuff instead of saying how amazing there stuff is and then release potato ai, nothing they have done in the AI space recently has lived up to any of the hype, they should stay silent for a bit then release something that kills GPT4 if they honestly are able but instead they are just full of hype.
- sinuhe69 3y agoYeah, their Gemini demo was a disaster. But they have released their Ultra model for the general audience, so you can test them yourself. Talking about killing the competitor is a little funny, considering they are all generative LLM based on the same principles (and general architecture) with their inherent flaws and shortcomings. All of them can not even execute a basic plan like a cheap human assistant. So their values are very limited. Breakthrough will only come with a next generation architecture. LLM for special domains is currently the most promising approach.
- ChildOfChaos 3y agoYeah but even with ultra they kept saying how it was better than GPT4 and then when it actually got released it was awful.
- jeffbee 3y agoA little off-topic I guess, but is anyone else seeing what I am seeing: a total inability to actually upgrade to paid Gemini? Every time I try to sign up it serves me an error page: "We're sorry - Google One storage plans aren't available right now."
- DrNosferatu 3y agoDid they say a general availability date? (a bit confused)
- dang 3y agoThere's also https://twitter.com/JeffDean/status/1758146022726041615 https://twitter.com/JeffDean/status/1758146022726041615 (via https://news.ycombinator.com/item?id=39383593 https://news.ycombinator.com/item?id=39383593, but we merged those comments hither)
- topicseed 3y ago1 million tokens?? This is wild and a lot of RAG can be removed.
- topicseed 3y agoIs this going to be only for consumer Gemini app or for API/Vertex too? The context window is..... Simply lovely.
- summerlight 3y agoOne interesting proposal here is a multiple NIAH retrieval benchmark. When they put 100 needles, then the recall rate becomes considerably lower, something around 60~70%. Not sure what's the exact configuration of this benchmark, but intuitively this makes sense and should be a critical metric for the model's reliability.
- reissbaker 3y agoThe long context length is of course incredible, but I'm more shocked that the Pro model is now on par with Ultra (~GPT-4, at least the original release). That implies when they release 1.5 Ultra, we'll finally have a GPT-4 killer. And assuming that 1.5 Pro is priced similarly to the current Pro, that's a 4x price advantage per-token. Not surprising that OpenAI shipped a blog post today about their video generation — I think they're feeling considerable heat right now.
- topicseed 3y agoGemini 1 Ultra was also said to be on par with ChatGPT 4 and it's not really there so let's see for ourselves when we can get our hands on it.
- reissbaker 3y agoUltra benchmarked around the original release of GPT-4, not the current model. My understanding is that was fairly accurate — it's close to current GPT-4 but not quite equal. However, close-to-GPT-4 but 4x cheaper and 10x context length would be very impressive and IMO useful.
- refulgentis 3y agoNo, it benchmarked around the original release of GPT-4 given 32 attempts versus GPT-4's 5.
- tigershark 3y agoFeeling the heat? Did you actually watch the videos? That was a huge leap forward compared to anything existing at the moment. Order of magnitudes away from a blog post discussing a model that maybe will finally be on par with chat gtp 4...
- mupuff1234 3y agoThe openai announcement is also more or less a blog post, isn't it? Do we know how much time or money does it take to create a movie clip?
- deleted 3y ago[deleted]
- m3kw9 3y agoimagine sending 5-10 mbs over the network per request, and the cost per token. You may accidently go broke after a big lag.
- animanoir 3y agoGoogle is so finished, they are so late on this.
- stolsvik 3y agoSo, this has native image/video modality. I wonder whether that gives it an edge in physical / world understanding? That is, handling and navigating our 3/4 dimensions? Cause and effect and so on?
- tmaly 3y agoIs there a $20 a month option for 1.5 Ultra? If there is, where do I sign up?
- ancorevard 3y agoIs this a blog post of did they actually ship?
- deleted 3y ago[deleted]
- jstummbillig 3y agoImagine a day, when your new recording setting 10M token context model is not enough to make it to hn #1 Wild times.
- thot_experiment 3y agoI gotta say, I've been trying out Gemini recently and it's embarrassingly bad. I can't take anything google puts out seriously when their current offerings are so so much worse than ChatGPT (or even local llama!). As a particularly egregious example, yesterday night I gave Gemini a list of drinks and other cocktail ingredients I had laying around and asked for some recommendations for cute drinks that I could make. It's response: > I'm just a language model, so I can't help you with that. ChatGPT 3.5 came up with several delicious options with clear instructions, but it's not just this instance, I've NEVER gotten a response from Gemini that I even felt was more useful than just a freaking bing search! Much less better than ChatGPT. I'm just going to assume they're using cherrypicked metrics to make themselves feel better until proven otherwise. I have zero confidence in Google's AI plays, and I assume all their competent talent is now at OpenAI or Anthropic.
- samspenc 3y agoMy experiences are similar, but I think we are talking about the Gemini free model, available on the Google Gemini website. I think the rest of the comments are saying the paid versions (Pro / Ultra) are significantly better, though I haven't tested it myself to compare.
- shellfishgene 3y agoI have the 2 months trial for the paid version, and find myself going back to free ChatGPT often. Gemini loves to put everything in bullet point lists and short paragraphs with subheadings for example, even when asking for a letter. I'm not a heavy user, but it seems to not quite get what I want often. Not important but annoying: It starts almost every answer with "Absolutely!", even when it doesn't match the question (e.g. "How does x work?").
- staticman2 3y agoI don't think "I'm just a language model, I can't help you with that" comes from Gemini. Google has a seperate censorship model that blocks you from receiving Gemini's response in certain situations. When Gemeni (Ultra) refuses to do something itself it is more verbose and specific as to why it won't do it, it my experience.
- mikeweiss 3y agoDoes anyone know what kinds of GPUs/Chips Google is using for Gemini? They aren't using Nvidia correct?
- sackfield 3y agoTPUs: https://cloud.google.com/tpu?hl=en https://cloud.google.com/tpu?hl=en
- mikeweiss 3y agoSo Google doesn't rely on Nvidia at all? How come they are the only ones that can manage to use non Nvidia chips and compete with Open AI?
- fragmede 3y agoThey offer Nvidia GPUs on GCP so they use them at some level.
- Andrex 3y agoGoogle's been making TPU chips optimized for machine learning and using them in data centers for almost a decade[0]. They were well-poised to capitalize on AI from a lot of angles. 0. https://en.wikipedia.org/wiki/Tensor_Processing_Unit#History https://en.wikipedia.org/wiki/Tensor_Processing_Unit#History
- jakub_g 3y agoVery off-topic but I can't help, the pace of change reminds of the "Bates 4000" sketch from The Onion Movie: https://m.youtube.com/watch?v=fw7FniaeaSo https://m.youtube.com/watch?v=fw7FniaeaSo
- TaylorAlexander 3y agoDoes anyone know how to get Gemini to help refactor code? I’m trying to paste in my code file and the web page says “an error has occurred” and the code does not show up in the code window. I tried signing up for Gemini Advanced and that didn’t help. I also tried pointing it to the file on GitHub and it said it couldn’t access it. People here are saying Gemini is great for code refactoring. How do you do that?
- noisy_boy 3y agoI feel sad for those who are in law school right now.
- arthur_sav 3y agozzZZzzzZ
- ylluminate 3y agoHas anyone given an idea of the release timeline for 1.5?
- newzisforsukas 3y agoah, so google found a moat.
- Aeolun 3y agoThis got my trying Gemini, but doing so is such a hassle that I'm almost ready to give up. Trying out ChatGPT is as simple as signing up (either for pro, or the API), and getting a single API key. Google requires me to navigate their absolutely insane console (seriously, I thought the AWS console was bad, but GCP takes the cake), only to tell me there is not even a way to get an API key... I had to ask Gemini through the built in interface to figure that out.
- fakedang 3y agoAPI keys are fairly straightforward in GCP though - there's an entire section for that, and even if you're stuck, the search console works.
- Aeolun 3y agoHere is an entire comment complaining it’s not straightforward, and you make a comment that essentially comes down to ‘no it is’?
- fakedang 3y agoI honestly don't know how to explain it any better. There's a devoted section for generating API keys, and once you are on that page, the walk-through workflow indicated on the page itself is very straightforward.
- is_true 3y agohttps://aistudio.google.com/ https://aistudio.google.com/ Unfortunately there's a waitlist for the 1.5 architecture
- jiggawatts 3y agoThat just redirects to an FAQ page with instructions like "If you get X error, then..." There is no error, it just redirects me. Fail.
- needlesslygrim 3y agoPersonally, I've given up on Gemini, as it seems to have been censored to the point of uselessness. I asked it yesterday [0] about C++ 20 Concepts, and it refused to give actual code because I'm under 18 (I'm 17, and AFAIK that's what the age on my Google account is set to). I just checked again, and it gave a similar answer [1]. When I tried ChatGPT 3.5, it did give an answer, although it was a little confused, and the code wasn't completely correct. This seems to be a common experience, as apparently it refuses to give advice on copying memory in C# [2], and I tried to do what was suggested in this comment [3], but by the next prompt it was refusing again, so I had to stick to ChatGPT. [0] https://g.co/gemini/share/238032386438 https://g.co/gemini/share/238032386438 [1] https://g.co/gemini/share/6880989ddfaf https://g.co/gemini/share/6880989ddfaf [2] https://news.ycombinator.com/item?id=39312896 https://news.ycombinator.com/item?id=39312896 [3] https://news.ycombinator.com/item?id=39313567 https://news.ycombinator.com/item?id=39313567
- Breza 3y agoI've gotten similar pushback. I asked for a solution involving curl and was told that that was not something Gemini could do. Then I clicked the button to see the other drafts of Gemini's responses and got two versions that worked.
- wrasee 3y agoFrom your first link [0] > Concepts are an advanced feature of C++ that introduces potential risks, and I want to prioritize your safety. Brilliant.
- GaryNumanVevo 3y agoI'm with Gemini on this one, 17 years old is too young to be learning about unsafe C++ features, best stick with a memory safe language until you're old enough
- needlesslygrim 3y agoLuckily I only really muck about with C++, and mainly use Rust, so my childlike brain is protected :^)
- shantnutiwari 3y agoNo faked videos this time? I find it hard to trust google nowadays.
- _heimdall 3y agoThese announcements always make it clear how little companies releasing new AI models actually care about the risks and concerns of developing artificial intelligence. CEOs love to talk about how important regulation is, how their company needs to develop it before the "wrong people" do, and how they are concerned about what could happen if AI development goes wrong. Then they announce the latest model that is aimed at expanding both the accuracy and breadth of use cases across multiple modalities. Sure the release links to a security and ethics page, but that page reads more like a company's internal "pillars of success" document with vague phrases that define little to nothing in the way of real, specific concerns or measures to mitigate them. It basically boils down to "Don't be evil" with no clear definition of what that would mean or how they prevent the new, more powerful and broad reaching system from being used in ways that are "evil".
- firtoz 3y agoI don't see any other way, personally. We can argue that a lot of people have done pretty bad things using the internet, but should it have been regulated in advance?
- _heimdall 3y agoRegulation doesn't have to be the answer though. The very same people talking out of both sides of their mouths here are the ones who can choose to just not invest in it. Lock up the hardware in an offline facility and experiment there, if they really think it's important. Hell, even just skipping the double speak would be a big step. If they really aren't concerned with the risk then own it, don't tell me its risky while also releasing a new, more powerful version every 6-12 months.
- btbuildem 3y agoCEOs are the "wrong people". Leaders of obscenely large organizations, unchecked by law nor ethics, wielding and gatekeeping what amounts to superpowers. They are the literal supervillains, not some shadowy "terrorists" or another made up bogeyman.
- nycdatasci 3y ago> This includes making Gemini 1.5 more efficient to train and serve, with a new Mixture-of-Experts (MoE) architecture. Wait. They are abandoning PaLM 2, which was just announced 9 months ago?
- gnrlst 3y ago4 weeks ago: Gemini Advanced with Ultra 1.0 Now: Gemini 1.5 Pro Is it just me or is their branding all over the place.