16 ms·
Gemini 2.5 Pro Preview
- jeswin 1y agoNow if there was a way to add prepaid credits and monitor usage near real-time on a dashboard, like every other vendor. Hey Google are you listening?
- greenavocado 1y agoYou can do that by using deepinfra to manage your billing. It's pay-as-you-go and they have a pass-through virtual target for Google Gemini. Deepinfra token usage updates every time you switch to the tab if it is opened to the usage page so it is possible to see updates even every second
- Hawkenfall 1y agoYou can do this with https://openrouter.ai/ https://openrouter.ai/
- pzo 1y agobut if you want to use google SDK (python-genai, js-genai) rather than openai SDK (If found google api more feature rich when using different modality like audio/images/video) you cannot use openrouter. Also not sure if you are developing app and needs higher rate limits - what's typical rate limit via openrouter?
- pzo 1y agoalso for some reason I tested simple prompt (few words, no system prompt) with attached 1 images and openrouter charged me like ~1700 tokens when on the other hand using directly via python-genai its like ~400 tokens. Also keep in mind they charge small markup fee when you top you their account.
- slig 1y agoIn in the meantime, I'm using openrouter.
- cchance 1y agoopenrouter, i dont think anyone should use google direct till they fix their shit billing
- greenavocado 1y agoEven afterwards. Avoid paying directly if you can because they generally could not care less about individuals. You have less than $10 million in spend you will be treated worse than cattle because at least farmers feed their cattle before they are milked
- tucnak 1y agoYou need LLM Ops. YC happens to have invested in Langfuse, which is if you're serious about tracking metrics, you'll appreciate the rest, too. And before you ask: yes, for cached content and batch completion discounts you can accommodate both—just needs a bit of logic in your completion-layer code.
- therealmarv 1y agoIs this on Google AI Studio or Google Vertex or both?
- simple10 1y agoYou can do this with LLM proxies like LiteLLM. e.g. Cursor -> LiteLLM -> LLM provider API. I have LiteLLM server running locally with Langfuse to view traces. You configure LiteLLM to connect directly to providers' APIs. This has the added benefit of being able to create LiteLLM API keys per project that proxies to different sets of provider API keys to monitor or cap billing usage. I use https://github.com/LLemonStack/llemonstack/ https://github.com/LLemonStack/llemonstack/ to spin up local instances of LiteLLM and Langfuse.
- ramesh31 1y ago>Best-in-class frontend web development It really is wild to have seen this happen over the last year. The days of traditional "design-to-code" FE work are completely over. I haven't written a line of HTML/CSS in months. If you are still doing this stuff by hand, you need to adapt fast. In conjunction with an agentic coding IDE and a few MCP tools, weeks worth of UI work are now done in hours to a higher level of quality and consistency with practically zero effort.
- shostack 1y agoWhat does your tool and model stack look like for this?
- ramesh31 1y agoCline with Gemini 2.5 (https://cline.bot/ https://cline.bot/) Framelink MCP (https://github.com/GLips/Figma-Context-MCP https://github.com/GLips/Figma-Context-MCP) Playwright MCP (https://github.com/microsoft/playwright-mcp https://github.com/microsoft/playwright-mcp) Pull down designs via Framelink, optionally enrich with PNG exports of nodes added as image uploads to the prompt, write out the components, test/verify via Playwright MCP. Gemini has a 1M context size now, so this applies to large mature codebases as well as greenfield. The key thing here is the coding agent being really clever about maintaining its' context; you don't need to fit an entire codebase into a single prompt in the same way that you don't need to fit the entire codebase into your head to make a change, you just need enough context on the structure and form to maintain the correct patterns.
- siwakotisaurav 1y agoUsually don’t believe the benchmarks but first in web dev arena specifically is crazy. That one has been Claude for so long, which tracks in my experience
- hersko 1y agoGive Gemini a shot. It is genuinely very good.
- jmkni 1y agoI built an entire web app using Gemini (the old version of this new preview model) for a side project a couple of weeks ago and it legit blew me away
- enraged_camel 1y agoI'm wondering when Claude 4 will drop. It's long overdue.
- danielbln 1y agoI was a little disappointed when the last thing coming out of Anthropic was their MAX pricing plan instead of a better model...
- Etheryte 1y agoFor me, Claude 3.7 was a noticeable step down across a wide range of tasks when compared to 3.5 with the same prompt. Benchmarks are one thing, but for real life use, I kept finding myself switching back to 3.5. Wouldn't be surprised if they were trying to figure out what happened there and how to prevent that in the next version.
- ranyume 1y agoI don't know if I'm doing something wrong, but every time I ask gemini 2.5 for code it outputs SO MANY comments. An exaggerated amount of comments. Sections comments, step comments, block comments, inline comments, all the gang.
- GaggiX 1y agoYou can ask to not use comments or use less comments, you can put this in the system prompt too.
- ChadMoran 1y agoI've tried this, aggressively and it still does it for me. I gave up.
- ziml77 1y agoI tried this as well. I'm interfacing with Gemini 2.5 using Cursor and I have rules to to limit the comments. It still ends up over-commenting.
- shawabawa3 1y agoI have a feeling this may be a cursor issue, perhaps cursors system prompt asks for comments? Asking in the aistudio UI for code and ending the prompt with "no code comments" has always worked for me
- ChadMoran 1y agohttps://github.com/x1xhlol/system-prompts-and-models-of-ai-tools/blob/main/Cursor%20Prompts/cursor%20agent.txt https://github.com/x1xhlol/system-prompts-and-models-of-ai-t...
- koakuma-chan 1y agoHave you tried threats?
- segphault 1y agoMy frustration with using these models for programming in the past has largely been around their tendency to hallucinate APIs that simply don't exist. The Gemini 2.5 models, both pro and flash, seem significantly less susceptible to this than any other model I've tried. There are still significant limitations, no amount of prompting will get current models to approach abstraction and architecture the way a person does. But I'm finding that these Gemini models are finally able to replace searches and stackoverflow for a lot of my day-to-day programming.
- thefourthchime 1y agoAsk the models that can search to double check their API usage. This can just be part of a pre-prompt.
- ksec 1y agoI have been asking if AI without hallucination, coding or not is possible but so far with no real concrete answer.
- mattlondon 1y agoIt's already much improved on the early days. But I wonder when we'll be happy? Do we expect colleagues friends and family to be 100% laser-accurate 100% of the time? I'd wager we don't. Should we expect that from an artificial intelligence too?
- cinntaile 1y agoIt's tool not a human so I don't know if the comparison even makes sense?
- ziml77 1y agoYes we should expect better from an AI that has a knowledge base much larger than any individual and which can very quickly find and consume documentation. I also expect them to not get stuck trying the same thing they've already been told doesn't work, same as I would expect from a person.
- xnx 1y agoThis is much bigger news than OpenAI's acquisition of WindSurf.
- herpdyderp 1y agoI agree it's very good but the UI is still usually an unusable, scroll-jacking disaster. I've found it's best to let a chat sit for around a few minutes after it has finished printing the AI's output. Finding the `ms-code-block` element in dev tools and logging `$0.textContext` is reliable too.
- OsrsNeedsf2P 1y agoLoading the UI on mobile while on low bandwidth is also a non-starter. It simply doesn't work.
- uh_uh 1y agoNoticed this too. There's something funny about billion dollar models being handicapped by stuck buttons.
- energy123 1y agoThe Gemini app has a number of severe bugs that impacts everyone who uses it, and those bugs have persisted for over 6 months. There's something seriously dysfunctional and incompetent about the team that built that web app. What a way to waste the best LLM in the world.
- kubb 1y agoIt's the company. Letting incompetent people who are vocal rise to the top is a part of Google's culture, and the internal performance review process discourages excellence - doing the thousand small improvements that makes a product truly great is invisible to it, so nobody does it. Software that people truly love is impossible to build in there.
- thebytefairy 1y agoLike what? I use it daily and haven't come across any seriously dysfunctional or incompetent.
- 1y ago
- crat3r 1y agoSo, are people using these tools without the org they work for knowing? The amount of hoops I would have to jump through to get either of the smaller companies I have worked for since the AI boom to let me use a tool like this would make it absolutely not worth the effort. I'm assuming large companies are mandating it, but ultimately the work that these LLMs seem poised for would benefit smaller companies most and I don't think they can really afford using them? Are people here paying for a personal subscription and then linking it to their work machines?
- jeffbee 1y agoNot every coding task is something you want to check into your repo. I have mostly used Gemini to generate random crud. For example I had a huge JSON representation of a graph, and I wanted the graph modified in a given way, and I wanted it printed out on my terminal in color. None of which I was remotely interested in writing, so I let a robot do it and it was fine.
- crat3r 1y agoFair, but I am seeing so much talk about how it is completing actual SDE tickets. Maybe not this model specifically, but to be honest I don't care about generating dummy data, I care about the claims that these newer models are on par with junior engineers. Junior engineers will complete a task to update an API, or fix a bug on the front-end, within a couple days with lets say 80 percent certainty they hit the mark (maybe an inflated metric). How are people comparing the output of these models to that of a junior engineer if they generally just say "Here is some of my code, what's wrong with it?". That certainly isn't taking a real ticket and completing it in any capacity. I am obviously very skeptical but mostly I want to try one of these models myself but in reality I think that my higher-ups would think that they introduce both risk AND the potential for major slacking off haha.
- jpc0 1y agoI don’t know about tickets but my org definitely happily pays for Gemini Advanced and encourages it’s use and would be considered a small org. The latest SOTA models are definitely at the point where they can absolutely improve workflows and not get in your way too much. I treat it a lot like an intern, “Here’s an api doc and spec, write me the boilerplate and a general idea about implementation” Then I go in, review, rip put crud and add what I need. It almost always gets architecture wrong, don’t expect that from it. However small functions and such is great. When it comes to refactoring ask it for suggestions, eat the meat leave the bones.
- ionwake 1y agoIs it possible to sue this with Cursor? If so what is the name of the model? gemini-2.5-pro-preview ? edit> Its gemini-2.5-pro-preview-05-06 edit>Cursor syas it doesnt have "good support" et, but im not sure if this is a defualt message when it doesnt recognise a model? is this a big deal? should I wait until its officially supported by cursor? Just trying to save time here for everyone - anyone know the answer?
- androng 1y agoAt the bottom of the article it says no action is required and the Gemini-2.5-pro-preview-03-25 now points to the new model
- ionwake 1y agowell alot of action was required such as adding the model so no idea what happened to the guy who wrote the article maybe there is a new cursor update now
- tough 1y agoCursor UI sucks, it tells me to use -auto mode- to be faster, but gemini 2.5 is way faster than any of the other free models, so just selecting that one is faster even if the UI says otherwise
- ionwake 1y agoyeah ive noticed this too, like wtf would I use Auto?
- tough 1y agoanother thing i hate is the cmd+enter (Accept) and cmd+del (cancel) being on the same button with tiny ui text and that changes interchangeably depending if its a command or edit or tool call
- chrisvalleybay 1y ago
- xbmcuser 1y agoAs a non programmer Gemini 2.5 Pro I have been really loving this for my python scripting for manipulating text and excel files for web scraping. In the past I was able to use Chat Gpt to code some of the things that I wanted but with Gemini 2.5 Pro it has been just another level. If they improved it further that would be amazing
- djrj477dhsnv 1y agoI don't understand what I'm doing wrong.. it seems like everyone is saying Gemini is better, but I've compared dozens of examples from my work, and Grok has always produced better results.
- hiddencost 1y ago[flagged]
- jimbokun 1y agoGood luck finding a commercial LLM not backed by a corporation with serious ethical issues.
- gembeMx 1y ago[dead]
- AstroBen 1y agonot everyone is american
- phacker007 1y agoNot everyone is not a racist.
- deleted 1y ago[deleted]
- mijoharas 1y agoA lot of non-americans have problems with Musk too. Tesla sales are cratering across all of Europe.
- cdelsolar 1y agoso it's ok to support a guy who's gutting the laws of another country if you're not from that country?
- 1y ago
- white_beach 1y agoobject? (aider joke)
- llm_nerd 1y agoTheir nomenclature is a bit confused. The Gemini web app has a 2.5 Pro (experimental), yet this apparently is referring to 2.5 Pro Preview 05-06. Would be ideal if they incremented the version number or the like.
- martinald 1y agoI'm totally lost again! If I use Gemini on the website (gemini.google.com), am I using 2.5 Pro IO edition, or am I using the old one?
- disgruntledphd2 1y agoCheck the dropdown in the top left (on my screen,at least).
- martinald 1y agoAre you referring to gemini.google.com or ai studio? I see 2.5 Pro but is this the right one? I saw a tweet from them saying you have to select Canvas first? I'm so so lost.
- koakuma-chan 1y agohttp://aistudio.google.com/app/prompts/new_chat?model=gemini-2.5-pro-preview-05-06 http://aistudio.google.com/app/prompts/new_chat?model=gemini...
- martinald 1y agoI get this in AI studio, but does it apply to gemini.google.com?
- pzo 1y ago"The previous iteration (03-25) now points to the most recent version (05-06), so no action is required to use the improved model"
- oellegaard 1y agoIs there anything like Claude code for other models such as gemini?
- mickeyp 1y agoI'm literally working on this particular problem. Locally-run server; browser-based interface instead of TUI/CLI; connects to all the major model APIs; many, many quality of life and feature improvements over other tools that hook into your browser. Drop me a line (see profile) if you're interested in beta testing it when it's out.
- oellegaard 1y agoI'm actually very happy with everything in Claude code, eg the CLI so im really just curious to try other models
- revicon 1y agoSame! I prefer the CLI, way easier when I’m connected via ssh from another network somewhere.
- mickeyp 1y agoThe CLI definitely has its advantages! But with my app: you can install the host anywhere and connect to it securely (via SSH forwarding or private VPN or what have you) so that workflow definitely still works!
- Filligree 1y agoI find that 2.5 Pro has a higher ceiling of understanding, while Claude writes more maintainable code with better comments. If we want to combine them... well, it should be easier to fix 2.5 than Claude. That said, neither is there yet. Currently Claude Code is a big value-add for Claude. Google has nothing equivalent; aider requires far more manual work.
- alphabettsy 1y ago
- mliker 1y agoThe "video to learning app" feature is a cool concept (see it in AI Studio). I just passed in two separate Stanford lectures to see if it could come up with an interesting interactive app. The apps it generated weren't too useful, but I can see with more focus and development, it'd be a game changer for education.
- SparkyMcUnicorn 1y agoAnyone know of any coding agents that support video inputs? Web chat interfaces are great, but copy/paste gets old fast.
- lostmsu 1y agoI wonder how it processes video. Even individual pictures take a lot of tokens.
- brap 1y agoGemini is now ranked #1 across every category in lmarena.
- aoeusnth1 1y agoLMArena is a joke, though
- killerstorm 1y agoWhy can't they just use version numbers instead of this "new preview" stuff? E.g. call it Gemini Pro 2.5.1.
- lukeschlather 1y agoI take preview to mean the model may be retired on an accelerated timescale and replaced with a "real" model so it's dangerous to put into prod unless you are paying attention.
- danenania 1y agoScheduled tasks in ChatGPT are useful for keeping track of these kinds of things. You can have it check daily whether there's a change in status, price, etc. for a particular model (or set of models).
- cdolan 1y agoI appriciate that you are trying to help But I do not want to have to build a network of bots with non-deterministic outputs to simply stay on top of versions
- danenania 1y agoNeither do I, but it's the best solution I've found so far. It beats checking models/prices manually every day to see if anything has changed, and it works well enough in practice. But yeah, some kind of deterministic way to get alerts would be better.
- lolinder 1y agoThey could still use version numbers for that. 2.5.1-preview becomes 2.5.1 when stable.
- mhh__ 1y agoAre you saying you find model names like o4-mini-high-pro-experimental-version5 confusing and stupid?
- andy12_ 1y agoInterestingly, when compering benchmarks of Experimental 03-25 [1] and Experimental 05-06 [2] it seems the new version scores slightly lower in everything except on LiveCodeBench. [1] https://storage.googleapis.com/model-cards/documents/gemini-2.5-pro-preview.pdf https://storage.googleapis.com/model-cards/documents/gemini-... [2] https://deepmind.google/technologies/gemini/ https://deepmind.google/technologies/gemini/
- arnaudsm 1y agoThis should be the top comment. Cherry-picking is hurting this industry. I bet they kept training on coding tasks, made everything worse on the way, and tried to hide it under the rug because of the sunk costs.
- luckydata 1y agoOr because they realized that coding is what most of those LLMs are used for anyways?
- arnaudsm 1y agoThey should have shown the benchmarks. Or market it as a coding model, like Qwen & Mistral.
- jjani 1y agoThat's clearly not a PR angle they could possibly take when it's replacing the overall SotA model. This is a business decision, potentially inference cost related.
- arnaudsm 1y agoFrom a business pov it's a great move, for the customers it's evil to hide evidence that your product became worse.
- cma 1y ago
- thevillagechief 1y agoI've been switching between this and GPT-4o at work, and Gemini is really verbose. But I've been primarily using it. I'm confused though, the model available in copilot says Gemini 2.5 Pro (Preview), and I've had it for a few weeks. This was just released today. Is this an updated preview? If so, the blog/naming is confusing.
- CSMastermind 1y agoHasn't Gemini 2.5 Pro been out for a while? At first I was very impressed with it's coding abilities, switching off of Claud for it but recently I've been using GPT o3 which I find is much more concise and generally better at problem solving when you hit an error.
- spaceman_2020 1y agoThink that was still the experimental model incorrectly labeled by many platforms as “Pro”
- 85392_school 1y agoThat's inaccurate. First, there was the experimental 03-25 checkpoint. Then it was promoted to Preview without changing anything. And now we have a new 05-06 checkpoint, still called Gemini 2.5 Pro, and still in Preview.
- laborcontract 1y agoMy guess is that they've done a lot of tuning to improve diff based code editing. Gemini 2.5 is fantastic at agentic work, but it still is pretty rough around the edges in terms of generating perfectly matching diffs to edit code. It's probably one of the very few issues with the model. Luckily, aider tracks this. They measure the old gemini 2.5 generating proper diffs 92% of the time. I bet this goes up to ~95-98% https://aider.chat/docs/leaderboards/ https://aider.chat/docs/leaderboards/ Question for the google peeps who monitor these threads: Is gemini-2.5-pro-exp (free tier) updated as well, or will it go away? Also, in the blog post, it says: > The previous iteration (03-25) now points to the most recent version (05-06), so no action is required to use the improved model, and it continues to be available at the same price. Does this mean gemini-2.5-pro-preview-03-25 now uses 05-06? Does the same apply to gemini-2.5-pro-exp-03-25? update: I just tried updating the date in the exp model (gemini-2.5-pro-exp-05-06) and that doesnt work.
- deleted 1y ago[deleted]
- okdood64 1y agoWhat do you mean by agentic work in this context?
- laborcontract 1y agoKnowing when to call functions, generating the proper function calling text structure, properly executing functions in sequence, knowing when it's completed its objective, and doing that over an extended context window.
- laborcontract 1y agoUpdate 2: I've been using this model in both aider and cline and I've haven't gotten a diff matching error yet, even with some pretty difficult substitutions across different places in multiple files. The overall feel of this model is nice. I don't have a formal benchmark but there's a notable improvement in code generation due to this alone. I've had gemini chug away on plans that have taken ~1 hour to implement. (~80mln tokens spent) A good portion of that energy was spent fixing mistakes made by cline/aider/roo due to search/replace mistakes. If this model gets anywhere close to 100% on diffs then this is a BFD. I estimate this will translate to a 50-75% productivity boost on long context coding tasks. I hope the initial results i'm seeing hold up! I'm surprised by the reaction in the rest of the thread. A lot unproductive complaining, a lot of off topic stuff, nothing talking about the model itself. Any thoughts from anyone else using the updated model?
- EliasWatson 1y agoI wonder how the latest version of Grok 3 would stack up to Gemini 2.5 Pro on the web dev arena leaderboard. They are still just showing the original early access model for some reason, despite there being API access to the latest model. I've been using Grok 3 with Aider Chat and have been very impressed with it. I get $150 of free API credits every month by allowing them to train on my data, which I'm fine with since I'm just working on personal side projects. Gemini 2.5 Pro and Claude 3.7 might be a little better than Grok 3, but I can't justify the cost when Grok doesn't cost me a penny to use.
- mohsen1 1y agoI use Gemini for almost everything. But their model card[1] only compares to o3-mini! In known benchmarks o3 is still ahead: +------------------------------+---------+--------------+ | Benchmark | o3 | Gemini 2.5 | | | | Pro | +------------------------------+---------+--------------+ | ARC-AGI (High Compute) | 87.5% | — | | GPQA Diamond (Science) | 87.7% | 84.0% | | AIME 2024 (Math) | 96.7% | 92.0% | | SWE-bench Verified (Coding) | 71.7% | 63.8% | | Codeforces Elo Rating | 2727 | — | | MMMU (Visual Reasoning) | 82.9% | 81.7% | | MathVista (Visual Math) | 86.8% | — | | Humanity’s Last Exam | 26.6% | 18.8% | +------------------------------+---------+--------------+ [1] https://storage.googleapis.com/model-cards/documents/gemini-2.5-pro-preview.pdf https://storage.googleapis.com/model-cards/documents/gemini-...
- jsnell 1y agoThe text in the model card says the results are from March (including the Gemini 2.5 Pro results), and o3 wasn't released yet. Is this maybe not the updated card, even though the blog post claims there is one? Sure, the timestamp is in late April, but I seem to remember that the first model card for 2.5 Pro was only released in the last couple of weeks.
- cbg0 1y agoo3 is $40/M output tokens and 2.5 Pro is $10-15/M output tokens so o3 being slightly ahead is not really worth 4 times more than gemini.
- jorl17 1y agoAlso, o3 is insanely slow compared to Gemini 2.5 Pro
- i_have_an_idea 1y agoNot sure why this is being downvoted, but it's absolutely true. If you're using these models to generate code daily, the costs add up. Sure, I'll give a really tough problem to o3 (and probably over ChatGPT, not the API), but on general code tasks, there really isn't meaningful enough difference to justify 4x the cost.
- gitroom 1y agoman that endless commenting seriously kills my flow - gotta say, even after all the prompts and hacks, still can't get these models to chill out. you think we'll ever get ai to stop overdoing it and actually fit real developer habits or is it always gonna be like this?
- arnaudsm 1y agoBe careful, this model is worse than 03-25 in 10 of the 12 benchmarks (!) I bet they kept training on coding, made everything worse on the way, and tried to hide it under the rug because of the sunk costs.
- deleted 1y ago[deleted]
- jstummbillig 1y agoIt seems that trying to build llms is the definition of accepting sunk cost.
- ramblerman 1y agowhere do you see that?
- arnaudsm 1y agoNew model homepage : https://deepmind.google/technologies/gemini/ https://deepmind.google/technologies/gemini/ Old model card : https://storage.googleapis.com/model-cards/documents/gemini-2.5-pro-preview.pdf https://storage.googleapis.com/model-cards/documents/gemini-... They intentionally buried that information
- nashashmi 1y agoI keep hearing good things about Gemini online and offline. I wrote them off as terrible when they first launched and have not looked back since. How are they now? Sufficiently good? Competent? Competitive? Or limited? My needs are very consumer oriented, not programming/api stuff.
- hmate9 1y agoProbably the best one right now, their deep research is also very good.
- danielbln 1y agoBard sucked, Gemini sucked, Gemini 2 was alright, 2.5 is awesome and my main driver for coding these days.
- thevillagechief 1y agoThe Gemini deep research is a revelation. I obsessively research most things I buy, from home appliances to gym equipment. It has literally saved untold hours of comparisons. You get detailed reports generated from every website including youtube reviews. I've bought a bunch of stuff on it's recommendation.
- Imanari 1y agocare to share your search prompt?
- thevillagechief 1y agoOh, really nothing special. I'll say something simple like "Which home gym leg press machine will give the best bang for my buck?"
- ramoz 1y agoNever sleep on Google.
- deleted 1y ago[deleted]
- panarchy 1y agoIs it just me that finds that while Gemini 2.5 is able to generate a lot of code that the end results are usually lackluster compared to Claude and even ChatGPT? I also find it hard-headed and frequently does things in ways I explicitly told it not to. The massive context window is pretty great though and enables me to do things I can't with the others so it still gets used a lot.
- scrlk 1y agoHow are you using it? I find that I get the best results from 2.5 Pro via Google AI Studio with a low temperature (0.2-0.3).
- panarchy 1y agoAI Studio as well, but I haven't played around with the temperature too much and even then I only lowered it to like 0.8 a few times. So I'll have to try this out. Thanks.
- xyst 1y agoProprietary junk beats DeepSeek by a mere 213 points? Oof. G and others are way behind
- mwigdahl 1y agoYes, specifically negative 213 points behind.
- childintime 1y agoHow does it perform on anything but Python and Javascript? In my experience my milage varied a lot when using C#, for example, or Zig, so I've learnt to just let it select the language it wants. Also, why doesn't Ctrl+C work??
- scbenet 1y agoIt's very good at Go, which makes sense because I'm assuming it's trained on a lot of Google's code
- simianwords 1y agoHow would they train it on google code without revealing internal IP?
- scbenet 1y agoGoogle has 2.8k public repositories on just their main github account (github.com/google). Even if they're not training on their closed source internal codebases (which they most certainly are, but fair point that they're probably not releasing the models trained on that data), it definitely seems like they have a lot of Go code in the training data.
- simianwords 1y agobut so do their competitors?
- obsolete_wagie 1y agoo3 is so far ahead of antrhopic and google, these models arent even worth using
- Workaccount2 1y agoo3 is expensive in the API and intentionally crippled in the web app.
- Squarex 1y agosource?
- obsolete_wagie 1y agouse the models daily, its not even close
- mattlondon 1y agoThe benchmarks (1) seem to suggest that o3 is in 3rd place after Gemini 2.5 pro preview and Gemini 2.5 pro exp (for text reasoning, o3 4th for webdev). o3 doesn't even appear on the openrouter leaderboards (2) suggesting is hardly used (if at all) by anyone using LLMs do actually do anything (such as coding) which makes one question if it is actually any good at all (otherwise if it was so great I'd expect to see heavy usage) Not sure where your data is coming from but everything else is pointing to Google supremacy in AI right now. I look forward to some new models from Anthropic, xAi, Meta et al (remains to be seen if OpenAI has anything left apart from bluster). Exciting times. 1 - https://beta.lmarena.ai/leaderboard https://beta.lmarena.ai/leaderboard 2 - https://openrouter.ai/rankings https://openrouter.ai/rankings
- obsolete_wagie 1y agoyou just arent using the models to their full capacity if you think this, benchmarks have all been hacked
- cellis 1y ago8x the cost for maybe 5% improvement?
- ionwake 1y agoCan someone tell me if windsurf is better than cursor? ( pref someone who has used both for a few days? )
- kurtis_reed 1y agoRelevance?
- ionwake 1y agoits what literally every hn coder is using to program with these models much as gemini.where u been brother
- ramoz 1y agoClaude Code and its not close. I feed my entire project to gemini for planning and figuring out complex solutions for claude code to execute on. I use Prompt Tower for building entire codebase prompts for gemini.
- ionwake 1y agofantastic reply thanks, can I ask if you have tried cursor? I use to use claudecode but it was super expensive and got stuck in loops. ( I know it is cheaper now). Do you have any thoughts?
- ramoz 1y agoI spend the money on Claude Code, and don't think twice. I've spent low 1,000s at this point but the return is justified. I use Cursor when I code myself. But I don't use it's chat or agent features. I had replaced VS Code with it but at this point I could go back to VS Code, but I'm lazy. Cursor agent/chat we're fine if you're bottlenecked by money. I have no idea why or how it uses things like the codebase embedding. An agent on top of a filesystem is a powerful thing. People also like Aider and RooCode for the CLI experience and I think they are affordable. To make the most use of these things, you need to guide them and provide them adequate context for every task. For Claude Code I have built a meta management framework that works really well. If I were forced to use cursor I would use the same approach.
- m_kos 1y ago[Tangent] Anyone here using 2.5 Pro in Gemini Advanced? I have been experiencing a ton of bugs, e.g.,: - [codes] showing up instead of references, - raw search tool output sliding across the screen, - Gemini continusly answering questions asked two or more messages before but ignoring the most recent one (you need to ask Gemini an unrelated question for it to snap out of this bug for a few minutes), - weird messages including text irrelevant to any of my chats with Gemini, like baseball, - confusing its own replies with mine, - not being able to run its own Python code due to some unsolvable formatting issue, - timeouts, and more.
- Dardalus 1y agoThe Gemini app is absolute dog doo... use it through AI studio. Google ought to shut down the entire Gemini app.
- paulirish 1y ago> Gemini 2.5 Pro now ranks #1 on the WebDev Arena leaderboard It'd make sense to rename WebDev Arena to React/Tailwind Arena. Its system prompt requires [1] those technologies and the entire tool breaks when requesting vanilla JS or other frameworks. The second-order implications of models competing on this narrow definition of webdev are rather troublesome. [1] https://blog.lmarena.ai/blog/2025/webdev-arena/#:~:text=PROMPTING%20STRATEGY%20AND%20SYSTEM%20DESIGN https://blog.lmarena.ai/blog/2025/webdev-arena/#:~:text=PROM...
- martinsnow 1y agoBwoah it's almost as if react and tailwind is the bees knees ind frontend atm
- xd1936 1y ago[flagged]
- byearthithatius 1y agoSadly. Tailwind is so oof in my opinion. Lets import megabytes just so we don't have to write 5 whole CSS classes. I mean just copy paste the code. Don't get me stared on how ugly the HTML becomes when most tags have 20 f*cking classes which could have been two.
- martinsnow 1y agoYou're doing it wrong. Tailwind is endlessly customizable and after compilation is only kilobytes. But yes lets complain because we don't understand the tooling....
- johnfn 1y agoIn most reasonably-sized websites, Tailwind will decrease overall bundle size when compared to other ways of writing CSS. Which is less code, 100 instances of "margin-left: 8px" or 100 instances of "ml-2" (and a single definition for ml-2)? Tailwind will dead-code eliminate all rules you're not using. In typical production environments tailwind is only around 10kb[1]. [1]: https://v3.tailwindcss.com/docs/optimizing-for-production https://v3.tailwindcss.com/docs/optimizing-for-production
- qwertox 1y agoI have my issues with the code Gemini Pro in AI Studio generates without customized "System Instructions". It turns a well readable code-snippet of 5 lines into a 30 line snippet full of comments and mostly unnecessary error handling. Code which becomes harder to reason about. But for sysadmin tasks, like dealing with ZFS and LVM, it is absolutely incredible.
- arresin 1y agoI’ve found the same thing. I don’t use it for code any more because it produces highly verbose and inefficient code that may work but is ugly and subtly brittle.
- mvdtnz 1y agoI truly do not understand how people are getting worthwhile results from Gemini 2.5 Pro. I have used all of the major models for lots of different programming tasks and I have never once had Gemini produce something useful. It's not just wrong, it's laughably bad. And people are making claims that it's the best. I just... don't... get it.
- WaltPurvis 1y agoThat's weird. What languages/frameworks/tasks are you using it for? I've been using Gemini 2.5 with Dart recently and it frequently produces indisputably useful code, and indisputably helpful advice. Along with some code that's pretty dumb or misguided, and some advice that would be counterproductive if I actually followed it. But "never once had Gemini produce something useful" is wildly different from my recent experience.
- mvdtnz 1y agoPlain JS with Alpine.js, Java with Spring Boot, Webflux and Netty. Flyway, Tailwind. Here's an example conversation. It claims it made a mistake (there was no mistake) then spits out pathetically unusable code, * Takes the first player's score, not the current player * Stores it as a high score without even checking if it's higher than the current high score * Stores high scores on a per-lobby basis against the given instructions * Does NOT store high scores on a per-configuration basis as instructed https://g.co/gemini/share/baafa0e89c3a https://g.co/gemini/share/baafa0e89c3a
- WaltPurvis 1y agoEgads. That’s really bad. I’ve had a few boneheaded responses like that, although I don’t recall any as awful as this example. I’m still figuring out when it’s going to be quicker and better to do something myself rather than putting effort into composing a long prompt which the AI may not understand anyway. One thing I’ve learned is there’s no point in arguing with the AI. if it gets something wrong, I will maybe try one time to explain the error and see if it can correct, but if it doesn’t, then any further attempts are just going to lead to a pointless cycle of the AI regurgitating the exact same error, or making it even worse, until I start using abusive language and give up. That said, I have had many successful interactions, where a 2-minute prompt and 3-5 minutes of me reviewing the output nets perfectly serviceable code that would have taken me considerably longer to implement myself, and I’ve found it consistently useful for suggesting approaches and brainstorming solutions.
- franze 1y agoI like it. I threw some random concepts at it (Neon, LSD, Falling, Elite, Shooter, Escher + Mobile Game + SPA) at it and this is what it came up with after a few (5x) roundtrips. https://show.franzai.com/a/star-zero-huge?nobuttons https://show.franzai.com/a/star-zero-huge?nobuttons
- cadamsdotcom 1y agoGoogle/Alphabet is a giant hulking machine that’s been frankly running at idle. All that resume driven development and performance review promo cycles and retention of top talent mainly to work on ad tech means it’s packed to the rafters with latent capability. Holding on to so much talent in the face of basically having nothing to do is a testament to the company’s leadership - even if said leadership didn’t manage to make Google push humanity forward over the last decade or so. Now there’s a big nugget to chew (LLMs) you’re seeing that latent capability come to life. This awakening feels more bottom-up driven than top down. Google’s a war machine chugging along nicely in peacetime, but now its war again! Hats off to the engineers working on the tech. Excited to try it out!
- kccqzy 1y ago> retention of top talent mainly to work on ad tech No the top talent worked on exciting things like Fuchsia. Ad tech is boring stuff written by people who aren't enough of a snob to refuse working on ad tech.
- cadamsdotcom 1y agoTop talent worked on what now? Isn’t that a flower? (Hopefully you see my point)
- alana314 1y agoThe google sheets UI asked me to try Gemini to create a formula, so I tried it, starting with "Create a formula...", and its answer was "Sorry, I can't help with creating formulas yet, but I'm still learning."
- wewewedxfgdf 1y agoGemini does not accept upload of TSX files, it says "File type unsupported" You must rename your files to .tsx.txt THEN IT ACCEPTS THEM and works perfectly fine writing TSX code. This is absolutely bananas. How can such a powerful coding engine have this behavior?
- krat0sprakhar 1y agoWhere are you testing this? I'm able to upload tsx files on aistudio
- wewewedxfgdf 1y agohttps://gemini.google.com/app https://gemini.google.com/app
- voidspark 1y agoUse aistudio.google.com
- wewewedxfgdf 1y agoI like using Gemini without an API key.
- radicality 1y agoFyi anything on AIStudio can be used for training and/or review, do not upload anything sensitive there.
- jmward01 1y agoGoogle's models are pretty good, but their API(s) and guarantees aren't. We were just told today that 'quota doesn't guarantee capacity' so basically on-demand isn't prod capable. Add to that that there isn't a second vendor source like Anthropic and OpenAI have and Google's reliability makes it a hard sell to use them unless you can back up the calls with a different model family all together.
- sjhatfield 1y agoAnd gemini-1.5-pro is months from depreciation and there is no production alternative. 2.0 does not pass our benchmarks and in a regulated industry we need time to move to a new modek
- andybak 1y ago("deprecation" not "depreciation")
- simonw 1y agoHere's a summary of the 394 comments on this post created using the new gemini-2.5-pro-preview-05-06. It looks very good to me - well grouped, nicely formatted. https://gist.github.com/simonw/7ef3d77c8aeeaf1bfe9cc6fd68760b96 https://gist.github.com/simonw/7ef3d77c8aeeaf1bfe9cc6fd68760... 30,408 input, 8,535 output = 12.336 cents. 8,500 is a very long output! Finally a model that obeys my instructions to "go long" when summarizing Hacker News threads. Here's the script I used: https://gist.github.com/simonw/7ef3d77c8aeeaf1bfe9cc6fd68760b96?permalink_comment_id=5568631#gistcomment-5568631 https://gist.github.com/simonw/7ef3d77c8aeeaf1bfe9cc6fd68760...
- cloudking 1y agoPelican on a bicycle?
- simonw 1y agoIt's very good! https://simonwillison.net/2025/May/6/gemini-25-pro-preview/#gemini-pelican https://simonwillison.net/2025/May/6/gemini-25-pro-preview/#...
- user_7832 1y ago> Finally a model that obeys my instructions to "go long" Something I have found is that when you give a reason for it, LLMs are more likely to do it. The first time I was in a metro with limited internet I told Claude (3.5) as such and asked it to reply in more detail as I could not type back and forth frequently… and it delivered extremely well. Since then I’ve found it to be a helpful prompt for all LLMs I’ve used it on.
- artdigital 1y agoGemini 2.5 pro is great, but also VERY expensive with non opaque cost insights Just recently a lot of people (me included) got hit with a surprise bill, with some racking up $500 in cost for normal use I certainly got burnt and removed my API key from my tools to not accidentally use it again Example: https://x.com/pashmerepat/status/1918084120514900395?s=46 https://x.com/pashmerepat/status/1918084120514900395?s=46
- dankwizard 1y agoJust add to your prompt "DO NOT burn many tokens you are capped at $8.50 buddy" it works wonders for me.
- danpalmer 1y agoFrom the linked tweet the author seems to be using Gemini through another layer called OpenRouter - it seems quite possible that the issue around lack of clarity of billing/caching could be from that extra layer of indirection.
- cma 1y agoOpenRouter lets you fund a wallet and spend no more than that. Google will let it go out of control and they purposely delay the billing console by up to 24 hours so if you don't track it all yourself you can get hit big, especially if it is a coding error that uses up to the rate limits.
- danpalmer 1y agoWell OpenRouter is also facading the API calls, so you may not get the full details of the response back from the upstream LLM service. As far as I can tell the Gemini API returns the token counts in its response enabling you to estimate billing yourself if you want to. > they purposely delay the billing console by up to 24 hours This is about scalability and performance. Billing for as many requests per second as a cloud provider gets can't be done live, without significant performance and reliability degradation.
- snthpy 1y agoI find the naming confusing. Haven't I already been using Gemini 2.5 Pro Preview for the past month? Or was that Experimental? Also how do i understand the OpenAI model names? I don't use OpenAI anymore since Ilya left but when looking at the benchmarks I'm constantly confused by their model names. We have semantic versioning - why do I need an AI or web search to understand your model name?
- munna5345 1y ago[dead]
- munna5345 1y ago[dead]
- seydor 1y agoI just wish all version numbers were just dates. Gemini 25.5.6
- croemer 1y ago> We have also updated the model card with the new version of 2.5 Pro No you haven't? At least not at 6am UTC on May 7. The PDF still mentions (03-25) as date of the model. What version do I get on gemini.google.com when I select "2.5 Pro (experimental)"? Has anything changed there or not (yet)?
- elAhmo 1y agoI honestly had to stop and think "wait a minute, was't 2.5 Pro out a few months ago? how come it is in preview now?" Google releasing a new model (as it has a blog post, announcement, can be chosen in the API) called 2.5 Pro Preview, while having a 2.5 Pro already out for months is ridiculous. I thought it was just OpenAI that is unable to use its dozens of billions of dollars to come up with a normal naming scheme - yet here we are with another trillion dollar company being unable to settle on a versioning scheme that is not confusing.
- planb 1y ago> We’ve seen developers doing amazing things with Gemini 2.5 Pro, so we decided to release an updated version a couple of weeks early to get into developers hands sooner. Today we’re excited to release Gemini 2.5 Pro Preview (I/O edition). What's up with AI companies and their model naming? So is this an updated 2.5 Pro and they indicate it by appending "Preview" to the name? Or was it always called 2.5 Preview and this is an updated "Preview"? Why isn't it 2.6 Pro or 2.5.1 Pro?
- rtaylorgarlock 1y agoAgreed. The current 'Pro 2.5 Preview' following another 'Preview' hurts my brain, and the beta badges we're all throwing on products aren't stopping people from using things in production. Rate limits only go so far.
- OrangeMusic 1y agoHonestly they're iterating so fast that it looks like they simply gave up giving their models proper version names. They should just use a date ¯\_(ツ)_/¯
- minzi 1y agoI use Gemini inside cursor, but the web app is basically unusable to me. Of the big three, only Claude seems to have a sensible web app with good markdown formatting, converting big pastes into attachments, and breaking out code into side panels. These seem like relatively obvious features so it’s confusing to me that Google is so behind on the UI here.
- lopatin 1y agoMy biggest issue with the UI is that it doesn’t let you edit your prompt if it’s not the latest one. If someone at Google is reading this, can you just implement it lol. Such a minor thing but really disrupts my workflow when dealing with a long conversation. I want to “rewind” the conversation basically.
- seidleroni 1y agoI'm not sure if this is just me, but with the "Starter Apps" I don't see how you can extend them using AI in aistudio. For example, there doesn't seem to be a way to add more code to the app with AI, even if you copy the Starter App. Am I missing something, or is this just a big miss from Google?
- mattmcknight 1y agoI'm getting a little tired of so many versions of 2.5. Whatever happened to 2.5.0, 2.5.1, et cetera?
- javiercr 1y agoMeanwhile Gemini 2.5 Pro support for VSCode Copilot is still broken :/ https://github.com/microsoft/vscode-copilot-release/issues/8404 https://github.com/microsoft/vscode-copilot-release/issues/8...
- seatac76 1y agoI’m always in awe of LLM code generation capabilities but it does make me sad, it’s not joyful and I feel terrible that I’m not learning anything.
- deleted 1y ago[deleted]
- zoogeny 1y agoI continue to find Gemini 2.5 Pro to be the most capable model. I leave Cursor on "Auto" model selection but all of my directed interactions are with Gemini. My process right now is to ask Gemini for high-level architecture discussions and broad-stroke implementation task break downs, then I use Cursor to validate and execute on those plans, then Gemini to review the generated code. That process works pretty well but not perfectly. I have two examples where Gemini suggested improvements during the review stage that were actually breaking. As an aside, I was investigating the OpenAI APIs and decided to use ChatGPT since I assumed it would have the most up-to-date information on its own APIs. It felt like a huge step back (it was the free model so I cut it some slack). It not only got its own APIs completely wrong [1], but when I pasted the url for the correct API doc into the chat it still insisted that what was written on the page was the wrong API and pointed me back to the page I had just linked to justify it's incorrectness. It was only after I prompted that the new API was possibly outside of its training data that it actually got to the correct analysis. I also find the excessive use of emojis to be juvenile, distracting and unhelpful. 1. https://chatgpt.com/share/681ba964-0240-800c-8fb8-c23a2cae09bf https://chatgpt.com/share/681ba964-0240-800c-8fb8-c23a2cae09...
- niteshpant 1y agoMy biggest frustration right now is just how much verbose the output is. Like a freshman aiming to hit that word count without substance, the model just spits out GenAI fluff. Good thinking otherwise.
- deleted 1y ago[deleted]
- deleted 1y ago[deleted]
- DonHopkins 1y ago[flagged]
- rendbendmend 1y ago[flagged]
- coopermichele85 1y ago[dead]