7 ms·

This is cool, but I wish it were integrated into tools already used for coding and writing rather than having it be a separate app. This also demonstrates the

• no_wizard 2y ago
  To be honest I think they’re having less success than it appears with their B2B offerings. A lot of cloud providers services like AWS have their own things they sell through those channels and I think a lot of businesses are finding those solutions to be cheaper and “good enough”
• ForHackernews 2y ago
  I think this is already built into Microsoft's Office365 "CoPilot" (which I assume is a ChatGPT frontend. You can ask the AI to make changes to your Office documents.
• w0m 2y ago
  If I'm reading this right; it's been in VSCode as Copilot Chat for a fair bit now. I use it often, when they added context (provide extra files to reference or even the entire @workspace if it's small enough), absolute gamechanger.
• qingcharles 2y ago
  Aren't we talking about, say, GitHub Copilot? That's integrated into Visual Studio/VSCode. I just started using it again as they've done some small upgrades, and the results can often be phenomenal. Like, I will visualize an entire block of code in my mind, and I'll type the first couple of characters and the entire block will just appear. I'm literally that predictable. Copilot is only using GPT3.5 for most of the results though, seemingly. I'd be more excited if they would update the API they're using.
• wenc 2y ago
  > This also demonstrates the type of things Google could do with Gemini integrated into Google Docs if they step up their game a bit. This is exactly what Google’s NotebookLM does. It’s (currently) free and it reads your Google Docs and does RAG on them. https://notebooklm.google/ https://notebooklm.google/
  • HarHarVeryFunny 2y ago
    The most amazing thing with notebooklm is that is can turn your docs into a very high quality podcast of two people discussing the content of your docs.
    • rty32 2y ago
      It is a cool concept, but anyone who listens to enough podcasts know that hosts have personalities and interests, and productions usually have their styles, focus and quality. These features make podcast channels unique and make you want to come back. That's why you may want to listen to podcast A instead of B even though they discuss the same topics. I doubt the Google thing will ever give us that -- likely just one hour of generic rambling that gets boring.
    • supafastcoder 2y ago
      It's fun the first time but it quickly gets boring.
    • 8338550bff96 2y ago
      Finding signal in noise is not an easy job given clip things are moving along. Whatever content creators need to do to deliver quality distilled content - I'm here for it.
    • ben_w 2y ago
      Juggling dog. It's not very good, but it's amazing that it's possible at all. https://github.com/BenWheatley/Timeline-of-the-near-future https://github.com/BenWheatley/Timeline-of-the-near-future I've only used the "Deep Dive" generator a few times, and I'm already sensing the audio equivalent of "youtube face" in the style — not saying that's inherently bad, but this is definitely early days for this kind of tool, so consider Deep Dive as it is today to be a GPT-2 demo of things to come.
• leetharris 2y ago
  > Honestly I’m scratching my head on OpenAI’s desire to double down on building out their consumer B2C use cases rather than truly focussing on being the infrastructure/API provider for other services to plug into I think it's because LLMs (and to some extent other modalities) tend to be "winner takes all." OpenAI doesn't have a long term moat, their data and architecture is not wildly better than xAI, Google, MS, Meta, etc. If they don't secure their position as #1 Chatbot I think they will eventually become #2, then #3, etc.
  • aflukasz 2y ago
    > If they don't secure their position as #1 Chatbot I think they will eventually become #2, then #3, etc. But can they do it at all? It's not like they are like early Google vs other search engines.
    • ben_w 2y ago
      At the moment this feels like a x10 speed run on the browser wars: lots of competitors very quickly churning who is "best" according to some metric, stuff getting baked into operating systems, freely licensed models. How do you make money off a web browser, to justify the development costs? And what does that look like in an LLM?
      • visarga 2y ago
        LLMs are a more flexible platform than browsers. They can be prompted, finetuned or run locally. Even if a company wants to make their base model spit ads, it won't fly.
        • ben_w 2y ago
          Depends how subtle they are about it, and what the rest of the ecosystem looks like. Perhaps the ad/ad-blocker analogy would be: You can have the free genuinely open source LLM trained only on Wikipedia and out-of-copyright materials, or you can have one trained on current NYT articles and Elsevier publications that also subtly pushes you towards specific brand names or political parties that paid to sponsor the model. Also consider SEO: every business wants to do that, nobody wants to use a search engine where the SEO teams won. We're already seeing people try to do SEO-type things to LLMs. If (when) the advertisers "win" and some model is spitting out "Buy Acme TNT, for all your roadrunner-hunting needs! Special discount for coyotes!" on every other line, then I'd agree with you, it won't fly, people will switch. But it doesn't need to start quite so bold, the first steps on this path are already being attempted by marketers attempting to induce LLMs crawling their content to say more good things about their own stuff. I hope they fail, but I expect them to keep trying until they succeed.
• mmaunder 2y ago
  Have you used Canvas?
• jcfrei 2y ago
  When they are focusing on just being an API provider then they will be in a market with (long term) razor thin margins and high competition - most likely unable to build a deep moat. But if you can shape customers habits to always input "chatgpt.com" into the browser whenever they want to use AI then that's a very powerful moat. Those customers will also most likely be on a subscription basis, meaning much more flexibility in pricing and more rent for openAI (people using it less then what OpenAI calculates for subscription costs).
  • aixpert 2y ago
    Your argument, which could be correct, makes their choice of the name ChatPGT* even more idiotic * Or which ever variant the average user might try to type in
  • movedx 2y ago
    This sounds like a good way of guaranteeing profits and moving the mindset away from just producing good products.
  • adventured 2y ago
    The difference between Google had it just tried to be an enterprise search API, versus owning the consumer destination for search input/results.
    • cynicalpeace 2y ago
      Google will be a remembered as a victim of Schumpeter's Creative Destruction
      • james_marks 2y ago
        From Wikipedia, for that don’t know the term: “a concept in economics that describes a process in which new innovations replace and make obsolete older innovations.” Ironically, I had to google it, and agree with the comment.
• debbiedowner 2y ago
  An LLM named Duet has been in Google docs for 17 months now! https://workspace.google.com/blog/product-announcements/duet-ai https://workspace.google.com/blog/product-announcements/duet... I've been using it for about a year.
  • franze 2y ago
    never figured out on how to activate it in my workspace
    • herval 2y ago
      google's approach to shipping products is puzzling. It's like they don't care if anyone uses them at all
      • Barrin92 2y ago
        Google isn't a startup, they aren't desperate to impress anyone. I don't even think they consider "AI" to be a product, which is probably correct. These AI enabled features are background processes that ideally integrate into products over time in ways that don't require you to explicitly know they're even there. Given how widely used Google Docs is, for serious work, disrupting people's workflows is not a good thing. Google has no problem being second, they aren't going to die in the next three months just because people on Twitter say so.
        • herval 2y ago
          I think what you mean is "Google is complacent, so they don't think they need to make a lot of effort to stay relevant"
    • karamanolev 2y ago
      Same here. I feel like Google's products have become such a labyrinth of features, settings, integrations, separate (but not really) products, that navigating them requires an expert. Sadly, I don't see a way back - each new additional feature or product is just bolted on top and adds more complexity. Given the corporate structure of Google, there's zero chance of an org-wide restructuring of the labyrinth.
• serjester 2y ago
  75% of OpenAI's revenue is coming from their consumer business - the better question is the long term viability of their public API. But if they believe they're going to reach AGI, it makes no sense to pigeonhole themselves to the interface of ChatGPT. Seems like a pretty sensible decision to maintain both.
  • 8338550bff96 2y ago
    75%? Thats astonishing to me. Where are you able to see those details? It wouldn't surprise me if not a lot of enterprises are going through OpenAI's enterprise agreements - most already have a relationship with Microsoft in one capacity or another so going through Azure just seems like the lowest friction way to get access. If how many millions we spend on tokens through Azure to OpenAI is any indication of what other orgs are doing, I would expect consumer's $20/month to be a drop in the bucket.
    • swarnie 2y ago
      It may be pretty minimal but i can personally vouch for 20ish techies in my own social orbit who's businesses wont authorise or wont pay for OpenAI yet and are doing so out of their own pockets; i share an office with four of them. Maybe the consumer side will slide as businesses pick up the tab?
      • 8338550bff96 2y ago
        I don't understand what paying for openai is meant to mean? You mean paying for tokens?
    • jdgoesmarching 2y ago
      This very good analysis estimates 73%, which includes team and enterprise. Given that enterprise access is limited and expensive, it seems Plus and Teams are mostly carrying this. The whole financial breakdown is fascinating and I’m surprised to not see it circulating more. https://www.wheresyoured.at/oai-business/ https://www.wheresyoured.at/oai-business/
• ren_engineer 2y ago
  ChatGPT itself is them copying their own API users, this is just them building out more features already built by users. My guess is they know they don't have a long term edge in models alone, so they are going to rely on expanding ChatGPT for better margins and to keep getting training data from users. They obviously want to control the platform, not integrate with other platforms
  • kridsdale3 2y ago
    The Amazon model. Same as it ever was.
• isignal 2y ago
  Consumer side can allow you to run ads and get Google like revenue in the future.
• briandear 2y ago
  Not sure how or why you’d want this integrated into Vim for instance.
  • ygjb 2y ago
    idk, I can definitely see value in a lightweight LLM component for VIM to help me look up the correct command sequence to exit :P
    • kridsdale3 2y ago
      HEY SIRI HOW DO I GET THE FUCK OUT OF VI
• riffraff 2y ago
  google has gemini integrated in Google Colab (jupyter notebooks) and while it doesn't work 100% well, it's a pretty great idea.
  • mark_l_watson 2y ago
    I only use Gemini in Colab perhaps 5% of the times I use Colab, yet it is nice to have. I use Gemini, OpenAI, Claude, smaller models in Grok, and run small models locally using Ollama. I am getting to the point where I am thinking I would be better off choosing one (or two.)
• herval 2y ago
  LLM as a service is much easier to replicate than physical data centers and there's a much lower potential user base than consumers, so I'd imagine they're swimming upstream into B2C land in order to justify the valuation
  • truetraveller 2y ago
    You mean downstream, not upstream. Upstream is closer to the raw materials.
    • herval 2y ago
      the bike shed is blue
• al_borland 2y ago
  I wouldn't be surprised to see Apple add something like this to Pages and some of their other apps. Their approach to AI, from what we've seen so far, has been about integrating it into existing apps and experiences, rather than making a separate AI app. I have to imagine this is the way forward, and these stand alone apps are basically tech demos for what is possible, rather than end-state for how it should be consumed by the masses. I agree with you on where OpenAI will/should sit in 5-10 years. However, I don't think them building the occasional tool like this is unwarranted, as it helps them show the direction companies could/should head with integration into other tools. Before Microsoft made hardware full time, they would occasionally produce something (or partner with brands) to show a new feature Windows supports as a way to tell the OEMs out there, "this is what we want you to do and the direction we'd like the PC to head." The UMPC[0] was one attempt at this which didn't take off. Intel also did something like this with the NUC[1]. I view what OpenAI is doing as a similar concept, but applied to software. [0] https://en.wikipedia.org/wiki/Ultra-mobile_PC https://en.wikipedia.org/wiki/Ultra-mobile_PC [1] https://en.wikipedia.org/wiki/Next_Unit_of_Computing https://en.wikipedia.org/wiki/Next_Unit_of_Computing
  • rty32 2y ago
    How many people use Pages these days? I don't think Apple even mentions the product in their WWDC these days. My guess is that most people either use Microsoft suite as required by their employer or use cloud based knowledge base/notes tools like Notion/Quip/Obsidian/Confluence etc. I doubt Apple thinks it worthwhile to invest in these products.
    • al_borland 2y ago
      People who need to make the occasional document outside of work, who don’t need to invest in paying for Office, use iWork. I count myself in that list. I use Office at work (99% of that usage is Excel), but at home I use the iWork apps. Mostly Numbers, but Pages as well. I hear many of my friends and family doing the same, because it’s what they have, it’s good enough, and it’s free. Few people outside of tech circles know what those other apps you mentioned are. I use Confluence at work, because it’s what my company uses. I also tried using it at home, but not for the same stuff I’d use Pages for. I use Obsidian at work to stay organized, but again, it doesn’t replace what I’d use Pages for, it’s more of a Notes competitor in my book. A lot of people don’t want their documents locked away in a Notion DB, and it’s not something I’d think to use if I’m looking to print something. I went back and looked at the last WWDC video. Apple did mention the apps briefly, to say they have integrated Image Playgrounds, their AI image generation, into Pages, Keynote, and Numbers. With each major upgrade, the iWork apps usually get something. Office productivity isn’t exactly the center of innovation these days. The apps already do the things that 80% of users need.
• 1659447091 2y ago
  > but I wish it were integrated into tools already used for coding Unless I'm missing something about Canvas, gh CoPilot Chat (which is basically ChatGPT?) integrates inline into IntelliJ. Start a chat from line numbers and it provides a diff before applying or refining.
  • gnatolf 2y ago
    > which is basically ChatGPT? Yea, I'm wondering the same. Is there any good resource to look up whether copilot follows the ChatGPT updates? I would be renewing my subscription, but it does not feel like it has improved similarly to how the new models have...
    • 1659447091 2y ago
      I check the GitHub blog[0] from time to time. They also have a RSS feed if you'd prefer that. The is also a waitlist for o1 access you may sign up for[1] [0] https://github.blog/changelog/label/copilot/ https://github.blog/changelog/label/copilot/ [1] https://github.blog/changelog/2024-09-19-sign-up-for-openai-o1-access-on-github/ https://github.blog/changelog/2024-09-19-sign-up-for-openai-...
    • maestrae 2y ago
      According to this (1), they are using the 4o model. And looks like you'll be able to pick your model(2) in the starting with version 1.94 released this September. 1.https://code.visualstudio.com/updates/v1_92#_github-copilot https://code.visualstudio.com/updates/v1_92#_github-copilot 2.https://code.visualstudio.com/updates/v1_94#_switch-language-models-in-chat https://code.visualstudio.com/updates/v1_94#_switch-language...
• svat 2y ago
  > the type of things Google could do with Gemini integrated into Google Docs Google already does have this in Google Docs (and all their products)? You can ask it questions about the current doc, select a paragraph and ask click on "rewrite", things like that. Has helped me get over writer's block at least a couple of times. Similarly for making slides etc. (It requires the paid subscription if you want to use it from a personal account.) https://support.google.com/docs/answer/13951448 https://support.google.com/docs/answer/13951448 shows some of it for Docs, and https://support.google.com/mail/answer/13447104 https://support.google.com/mail/answer/13447104 is the one for various Workspace products.
  • Zinu 2y ago
    Those look more like one-off prompts, and not a proper chat/collab with Gemini.
    • svat 2y ago
      That's there too; see https://support.google.com/docs/answer/14206696 https://support.google.com/docs/answer/14206696 — you can click on the "Ask Gemini ⟡" and carry on a conversation, e.g. "summarize emails about <topic>" and use those to paste into the doc. (I haven't found all that much use for referencing other files though. But the "proper chat" is useful for saying things like "no actually I meant something more like: …" and carrying on.)
• JumpCrisscross 2y ago
  > demonstrates the type of things Google could do with Gemini integrated into Google Docs Or Microsoft! > think OpenAI will end up being either an infrastructure provider OR a SaaS, but not both Microsoft cut off OpenAI's ability to execute on the former by making Azure their exclusive cloud partner. Being an infrastructure provider with zero metal is doable, but it leaves obvious room for a competitor to optimise.
  • rty32 2y ago
    Eh, GitHub CoPilot? Microsoft is literally THE company that understands developers' workflows and creates good IDEs.
  • munchler 2y ago
    Microsoft is integrating Copilot into many of their products, including Visual Studio and Office/365.
    • joseda-hg 2y ago
      VSCode Sure, but my experience with Copilot + regular Visual Studio has been nothing short of abismal
• carom 2y ago
  Their API is unusable due to rate limits. Myself and my wife have both had ideas, started using it, and found other approaches after hitting rate limits. I tried funding more money in the account to increase the rate limits and it did not work. I imagine they see poor growth there because of this.
  • byearthithatius 2y ago
    You need to use it for some time to get into their higher tiers of usage. I used to also have this problem and it annoyed me greatly, but once I got to usage tier 4 it never happened again (except for o1-preview but that just wastes tokens IMO).
  • bearjaws 2y ago
    It's pretty trivial to get increased limits, I've used the API for a few consulting projects and got to tier 4 in a month. At that point you can burn near $200 a day and 2 million tokens per minute. You only need 45 days to get tier 5 and if you have that many customers after 45 days you should just apply to YC lol. Maybe you checked over a year ago, which was the wild wild West at the time, they didn't even have the tier limits.
    • epolanski 2y ago
      > and if you have that many customers after 45 days you should just apply to YC lol. What for? If someone has already a business and customers he's already far off the average YC startup.
      • kridsdale3 2y ago
        Who doesn't like free money and marketing?
        • epolanski 2y ago
          It's not free money, you give up on a sizeable amount of equity (7%) you could also sell for more than half a million. It depends really on the business and what not.
• rising-sky 2y ago
  > but I wish it were integrated into tools already used for coding and writing rather than having it be a separate app Take a look at cursor.com
  • fakedang 2y ago
    Cursor is a funny company. They were invested into by OpenAI, but almost everyone using Cursor uses it with Claude Sonnet 3.5.
• epolanski 2y ago
  Being just a service provider makes you easy to replace with other service providers. Professionals instead don't love to change the tools once they got used to it for small incremental gains.
  • zmgsabst 2y ago
    But my subscription at $20/mo is a fraction of my API usage at $5/day (about $100/mo). You can sell a lot more GPT services through a higher bandwidth channel — and OpenAI doesn’t give me a way to reach the same bandwidth through their user interface.
• bastawhiz 2y ago
  I suspect they are building their B2C products because it gives them better data to train on. It's a lot harder to control the quality of data when you have no idea how API inputs were produced, what the UI is like, or who the users are. You don't know the provenance of the data, or the context. Or even if multiple unrelated client products are being commingled through the same key. If you control the UI, you have none of those problems.