3 ms·
> 1M token context by default is the big feature here IMO, but we need better benchmarks to measure what that really means. Multimodality in a model That's bet
by dragonwriter 3y ago
> 1M token context by default is the big feature here IMO, but we need better benchmarks to measure what that really means.
Multimodality in a model That's between 4-7% the cost per token of OpenAI’s cheapest multimodal model is an important feature when you are talking about production use and not just economically unsustainable demos.
- refulgentis 3y agoIn preview, can't be used in production, they already rug-pulled people building on Gemini w/r/t cost and RPM, and they're pointedly not putting any RPM or cost on the page. (seriously, try finding info on cost, RPM, or release right now, you're linked in circles.) Agree on OpenAI multimodal but it's sort of a stilted example itself, it's because OpenAI has a hole in its lineup - ex. Claude Haiku is multimodal, faster, and significantly cheaper than GPT 3.5.
- dragonwriter 3y ago> they're pointedly not putting any RPM or cost on the page 360 RPM base limit, pricing is posted. > seriously, try finding info on cost, RPM, or release right now, I wasn't making up numbers, its on their Gemini API pricing page: https://ai.google.dev/pricing https://ai.google.dev/pricing
- refulgentis 3y agoNice, thanks (btw, I didn't think you were making it up, it was in the keynote!)
- causal 3y ago+1 on Haiku being oft overlooked.
- verdverm 3y agoShows the power of the brand and the limit of names consumers will recall long term "Who are the biggest soda or potato chip makers?"
- refulgentis 3y ago[flagged]
- verdverm 3y ago1. Not an AI specific comment series, it applies generally 2. Comments like yours are against the guidelines of HN 3. You don't know what I do and are incorrect in your assessment of my work and experience (another common HN mishap) --- (re: #2/3) Please make your substantive points without crossing into personal attack. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- anoncareer0212 3y agoWhat do you mean? A) This fills a gaping hole for cheap multimodal models, OpenAI doesn't have one B) Anthropic's Haiku is a good choice. You) wow A didn't know Anthropic. Goes to show power of brands, much like snack foods B) Eh I wouldn't conclude anything from A. Its one comment. some people don't know what an Anthropic is because there's high interest in AI relative to interest in AI APIs. you can expect a low SNR ratio, even on HN You) Stop personally attacking me! It's against the rules!!
- verdverm 3y ago> You) Stop personally attacking me! It's against the rules!! Your comment history certainly shows a disregard for the HN guidelines https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- refulgentis 3y ago
- leetharris 3y agoThe problem is that even 1.5 Pro seems completely useless for long context multimodal stuff. I have tried it for so many use cases in video / audio and it hallucinates an unbelievable amount. More than any other model I've ever used. So if 1.5 Pro can't even handle simple tasks without hallucination, I imagine this tiny model is even more useless.