13 ms·

Let's Talk about ChatGPT with Code Interpreter and Microsoft Copilot

145 points by stuckinhell 3y ago

behnamoh 3y ago
Microsoft and Google adding LLMs to their ecosystem makes sense. But I don't see Apple adding something similar to MS Copilot to Numbers, Pages, etc. In a way, Apple seems to signal lack of hope for getting into the AI game. Soon, Apple will just be a "commodity" producer[0]: the company that makes the machines in the background, while other pioneers actually provide cutting edge technologies for those machines (e.g., local LLMs). Something like the oil companies, chip industry, etc. Apple will be making the iPhones and Macs and that's about it. They're too conservative to get out of their comfort zone now. In a weird way, it's actually still aligned with their "think different" motto: when everyone is thinking about getting on the AI bandwagon, think different and avoid doing that! [0]: Which is fine—the world needs boring companies as much as pioneers who break things.
- moonchrome 3y ago
  Or Apple will do what they always do, wait for the tech to mature then buy some big player like anthropic and integrate it into their products.
  - behnamoh 3y ago
    Their track record shows if they can't tightly control a technology, they won't touch it. LLMs can be bent in different ways and Apple wouldn't allow that. I own Apple devices, but I just don't see Apple play in the Google/MS/ClosedAI's field by saying "Our model is 20% larger than the best models out there...". Also, Apple should first fix Siri, or get rid of it for good. It's a joke at this point.
    - agloe_dreams 3y ago
      I would argue that Siri is an example of a lightly controlled technology. My bet is that Apple will appear behind for 2-4 years and out of nowhere will launch a Spike Jonze's Her-style "Samantha" that was in R&D for years.
      - sebzim4500 3y ago
        I don't think this is possible. There aren't that many AI researchers and they talk to each other. If Apple was making a serious AI push it would be obvious.
        noahtallen 3y ago
        There actually have been rumors about this: https://www.macrumors.com/2023/05/22/apple-ramps-up-hiring-of-ai-experts/ https://www.macrumors.com/2023/05/22/apple-ramps-up-hiring-o... (and I remember hearing more before April as well.) I feel like any company which has chatbots as a "core" part of their systems (like Siri is often advertised to be) would be looking very heavily into generative AI. It makes way too much sense and would clearly make Siri way more useful. Imagine if Siri was current ChatGPT with plugins for interacting with the OS -- this immediately solves basically all the complaints about Siri. Plus Apple has efficient local AI acceleration already, which could make it even better. It feels so obvious it'd be weird if they weren't trying to make a better Siri with gen AI! I have a feeling we'll hear about it either at WWDC or the iPhone event in the fall.
        chaxor 3y ago
        They will likely make Siri an LLM but not make a big deal about it. Just simply put it as a minor revision note, because that's effectively all it is.
      - behnamoh 3y ago
        The thing about these technologies is that you can't repeat the same recipe for iPhone. Even 6 months is too long a time for a company to stay behind. The rate of progress in this field, combined with the insane VC money driven up by the hype around LLMs, means that no company can afford "surprising" everyone by waiting just a bit longer. Google did that and see where they are now.
        noahtallen 3y ago
        You're right, but we're talking about Apple. While they may not be able to introduce a ChatGPT competito, Siri basically has a captive audience. With OS-level integrations, you can easily imagine a much more powerful and interactive Siri which becomes popular just because it's available out of the box and offers OS level integrations which a 3rd party chatbot can't. It's also not like AI tools are why people buy Apple products. So "waiting" probably doesn't cost them much money -- it doesn't impact their core hardware and service revenue. It's "just" a value add for now.
    - sebzim4500 3y ago
      Not convinced. The most useful feature of the first iPhone was it's web browser. Apple had/has very loose control over what people use it for.
      - behnamoh 3y ago
        True, but Apple still controls what web engine you use on iOS and what extensions you can install there.
        cube2222 3y ago
        Which, according to rumors, will change soon and be announced on WWDC, due to EU regulation.
    - iknowstuff 3y ago
      Siri is great! The on device recognition makes it far more reliable
  - wilg 3y ago
    Hardly always their playbook, they rarely make big acquisitions like that. Siri back in the day, Beats, P.A. Semi, are the most notable acquisitions.
    - moonchrome 3y ago
      I was trying to say that they usually don't introduce bleeding edge tech to their products and lag on adoption till the tech is polished enough. For acquisition yeah I was thinking along the lines of Siri.
- judge2020 3y ago
  To be fair, it often seems like they've forgotten about all of their office apps outside of Keynote.
- agloe_dreams 3y ago
  The wild bit about this is this: Imagine reading this comment 6 months ago. A person would probably spit their drink out..but it is true. Apple will spend WWDC talking about XR like it is a 2021 Facebook Earnings Call.
  - TeMPOraL 3y ago
    Even wilder bit: imagine reading any of this 6 months ago. ChatGPT just came out. It was a fun toy with some potential, but mostly seen as another example of the copilot-y "might make some jobs somewhat different in the mid-term future" tech demo. Who would've thought that in just four months, GPT-4 will completely transform people's perception of AI progress timeline and impact.
- headcanon 3y ago
  Apple has always been a consumer product-focused company. Even if computing continues to become more invisible and omnipresent, even if we no longer use laptops and phones, there will still be some kind of physical "product" at the end of the day, and thats where Apple will continue to exist. For LLMs, I don't see Apple opening up a general-purpose LLM or search engine like ChatGPT or Bing, its difficult to differentiate themselves in a meaningful way. I can see them developing a unique "personality" to Siri and integrating its behavior into existing devices and APIs. There's still a lot of room between where we are now and a personal AI-buddy like in "Her", so I imagine Apple is at least interested in moving in that direction.
- crazygringo 3y ago
  It's strange to me that you think Apple will become a "commodity" producer when it has the largest profit margins in the industry. Which is the exact opposite of how commodities function in economics. Yes Apple's focus is hardware as opposed to software, but there is commodity hardware and non-commodity hardware. Apple is firmly in the non-commodity camp and shows no signs of changing. Things like M2 chips are not "commodity". I have no idea what Apple will do with LLM's. But Apple is already leveraging ML in things like built-in local dictation and OCR, and we can probably expect that it will leverage things like LLM's at the OS level (iOS/macOS) rather than focusing on their iWork suite. (Honestly at this point I don't understand Apple's strategic purpose with iWork, or even Final Cut Pro.)
  - htss2013 3y ago
    Do the high profits come from the hardware or from rent seeking behavior in the app store and elsewhere?
    - crazygringo 3y ago
      They definitely come from the hardware, I'm talking about profits from the sale of hardware alone. In April 2023, Apple has a 30% market share of smartphones worldwide [1]. And in the first 3 months of 2023, Apple accounted for 50% of global smartphone revenue... and 80 percent of the industry's profits [2]. These is smartphone revenue, not services revenue. (Apple makes money from the App Store too but that's separate.) 80% of industry profit from 30% market share is certainly not a commodity. Cheap Android phones are a commodity. iPhones are the polar opposite. [1] https://www.oberlo.com/statistics/smartphone-market-share#:~:text=The%20latest%20statistics%20on%20the,worldwide%20use%20an%20Apple%20phone https://www.oberlo.com/statistics/smartphone-market-share#:~.... [2] https://www.statista.com/chart/29925/apples-share-of-the-global-smartphone-market/#:~:text=Thanks%20to%20its%20high%20average,first%20three%20months%20of%202023 https://www.statista.com/chart/29925/apples-share-of-the-glo....
- alfalfasprout 3y ago
  Huh? The reality is "cutting edge" doesn't necessarily mean it's a great product for consumers. Also frankly, productionalizing LLMs is very different from making research strides on them. Even inside Google researchers are realizing that a bulk of the improvements are now coming from the OSS community. Apple will implement these technologies when it makes sense to do so.
  - behnamoh 3y ago
    cgpt is already a product that serves consumers very well. No need to “productionalize” it.
- rad_gruchalski 3y ago
  > Apple will be making the iPhones and Macs and that's about it. They're too conservative to get out of their comfort zone now. Why would Apple even pursue LLMs? They are building hardware: computers, phones, screens, accessories. In a sense, that’s what you said. Just phrasing a question to your thought.
justanotheratom 3y ago
Considering the cost of running these LLMs behind the scenes, and the giant customer base of Office, Windows, Bing, Edge, etc. I wonder how Microsoft will keep things profitable. I guess they can just raise subscription price of Microsoft 365 at some point.
- partiallypro 3y ago
  Microsoft has tons of cash and on-going profits to be a loss leader for a while, also I imagine they will eventually limit some features to Microsoft 365 users only. They already charge extra for Teams with Copilot, etc; that's not a standard Teams feature. They also announced a "copilot" stack today, which I imagine they will charge for API usage on top of what they are going to be making from ChatGPT.
- pixl97 3y ago
  With the operating costs of AI at this time, this is going to be the big question for everyone. One of these you can't afford not to have it, but your can't afford to have it either. With all this said, Microsoft/Google/Apple have been sucking up stupid profits for decades now and it really is time for their unlimited money machine to have some pushback.
- PeterStuer 3y ago
  Same would have been said of running IBM mainframes in the 1970's no?
YousefED 3y ago
What makes me most excited about this is that it uses LLMs in a way that the result (a computer program) is still understandable and editable (hackable). Instead of having an AI model output some kind of "black-box conclusion" on a data set / question, it can output code that we can inspect, improve, and learn from. Using LLMs in this way still keeps us as users "in control" - and I think it's a promising path for responsible AI. I've done some experiments[1] adding ChatGPT-like functionality to my open source Typescript Notebook environment[2] back in december, and hope to revisit this soon :) [1] https://twitter.com/YousefED/status/1599805936280907776 https://twitter.com/YousefED/status/1599805936280907776 [2] https://www.typecell.org/ https://www.typecell.org/
- derwiki 3y ago
  I completely agree that the best LLM output is something that is still understandable/hackable -- and maybe even _needs_ further hacking. That's what I tell people when they say "I heard AI is replacing programmers."
  - whitemary 3y ago
    In the aggregate, it is in fact replacing programmers; just not all of them.
taf2 3y ago
Been using copilot with vim for a few weeks and my only issue has been when the file i'm editing is large the node process goes to like 100% and my typing is severely lagged... i quickly do :Copilot disable and move on with my day but really hoping the performance can improve, it's helpful when it works.
- michaelmior 3y ago
  You may want to check out Codium[0]. I haven't used Copilot with Vim, but I've never experienced a CPU issue with Codium. Bonus is that it's free! (You would be right to be concerned about the something for nothing here. Personally I was satisfied by their blog post on the subject[1], but of course you need to decide what's right for you.) [0] https://www.codium.com/ https://www.codium.com/ [1] https://codeium.com/blog/how-is-codeium-free https://codeium.com/blog/how-is-codeium-free
  - prometheon1 3y ago
    Codium and Codeium are different products
padolsey 3y ago
For me the most awesome thing here is the 100MB file upload function. May sound like nothing, but this is groundbreaking when we've been so far constrained by token limits. This means we don't need to endure an arduous back-and-forth process of giving it tiny pieces of data, code, and increasingly creative prompts. It can now just injest an entire dataset or software project and make swathing changes of all manner. This is going to disrupt everything (and already is..). I'm left wondering what the role of a software eng is and all I can come up with is a glorified quality analyst. Nothing wrong with that, but it's just such a transformation, and so sudden. I'm excited, scared, and exhausted all at the same time!
- JohnFen 3y ago
  > Nothing wrong with that Unless, of course, you want to be a software engineer. If all there is to my career is checking generated code for correctness, then there is nothing of value in my career anymore. That's not how it will be, though. At worst, there will still be niches I can fit in.
  - fbrncci 3y ago
    I could imagine that we will probably be checking generated code for correcteness while integrating larger parts of generated code. And due to the sheer complexity will need an en engineering understanding to make it all work. I’m excited for that, because it means I can do more with my time. But I also understand how that is not everyone’s cup of tea. > Unless, of course, you want to be a software engineer. It’s time to adapt to a changing world.
    - JohnFen 3y ago
      > I could imagine that we will probably be checking generated code for correcteness while integrating larger parts of generated code. So we're all to become systems integrators? I'm genuinely happy that excites you. Personally, I find the prospect depressing. > It’s time to adapt to a changing world. How do you adapt to no longer being able to do what you love to do? Saying "it's time to adapt" doesn't address the fundamental issue here at all. Obviously, we have to adapt. The question is how to do that and, if happiness is no longer on the table, at least be able to maintain some amount of career satisfaction. If I can't write software, then my career as a dev is over, no?
occamschainsaw 3y ago
I really want to try the code interpreter. I got access to the plugins early but there was no browsing and interpreter. Then I got access to browsing when they released it widely last week. Does anybody know how to get access to the code interpreter? I have lost track of all the ${LLM_Service} waitlists I have signed up for.
- RecycledEle 3y ago
  Same here.i also want the upload feature, which MY ChatGPT Plus lacks.
anotherpaulg 3y ago
In shameless attempt to raise awareness about my open source gpt-4 coding tool "aider" [1], I replicated the author's US Census data analysis example from the command line. This doesn't require the beta ChatGPT plugins, just a gpt-4 api key. You can see in the chat transcript [2] that I had GPT-4 tell me how to download census data, suggest some hypotheses to test, test one, summarize the results and plot a graph. As we went along, I had it write the code for all that as a python script in my local git repo. [1] https://github.com/paul-gauthier/aider https://github.com/paul-gauthier/aider [2] https://aider.chat/examples/census.html https://aider.chat/examples/census.html
- Tostino 3y ago
  Getting an API key has been just a waiting game here... Not been approved through work or personally yet after almost 3 months. I already have plugin access though, it's...alright. The web browsing leaves a ton to be desired.
  - anotherpaulg 3y ago
    Ya, I'm not sure why I got lucky to receive one. For coding tasks, gpt-4 really is significantly better than 3.5. I've been building tools for coding with GPT for a few months now, and they got way more effective and reliable with gpt-4.
  - TheHumanist 3y ago
    The thing I've used browsing for the most is linking to lengthy markdown files for large initial prompts with heavy detail. It works alright. Not perfect but decent.
oidar 3y ago
https://archive.is/20230504163052/https://www.oneusefulthing.org/p/it-is-starting-to-get-strange https://archive.is/20230504163052/https://www.oneusefulthing...
loudmax 3y ago
I wonder about the copyright status of code put out by ChatGPT. I presume anything ChatGPT generates belongs to the user who asked for the code to be generated. Is there any clause in the EULA that says this is the case? Or is code generated by ChatGPT automatically BSD-licensed? Or can ChatGPT claim ownership or joint-ownership of code generated using their tools? Another question is the code it was trained on. Presumably all of it was open source. BSD-licensed code typically requires attribution. GPL code requires anything copied to remain GPL. If the GPT is reproducing small stanzas of code from memory it probably doesn't matter. If GPT reproduces larger blocks of code from stuff that it was trained on, there is a possibility of failing to comply with copyright.
- JohnFen 3y ago
  > I presume anything ChatGPT generates belongs to the user who asked for the code to be generated. Machine generated works cannot be copyrighted, only human-created works. The part here that has yet to be determined is whether or not AI output is considered "machine generated". An argument could be made that writing a prompt is sufficient control to consider the output human-made for the purposes of copyright. If that's the case, then copyright will go to the human who wrote the prompt (or their employer). This will, at some point, have to be decided in court. Right now, the only answer is "nobody knows".
  - randyrand 3y ago
    Photographers own their images, even if the scene was set up by someone else. Pushing a button is sufficient to own copyright, in theory.
    - JohnFen 3y ago
      Right, which is why I think that courts will end up deciding that writing a prompt is sufficient control. But as of this moment, none of this has been decided -- so nobody actually knows.
    - lewhoo 3y ago
      I think in this case the product is the scene and not the picture though. If one could copyright the result of a prompt then I assume no one else could use the same (or very similar) prompt for profit as it is likely to produce similar code whereas a scene can be photographed for profit by anyone regardless if a similar picture has already been taken, or so I assume. If Andy Warhol just photographed Prince in a same/similar pose and clothes would there be the lawsuit case ? I don't think so.
simonw 3y ago
ChatGPT Code Interpreter really is incredibly useful. In addition to data analysis stuff, I've also used it for running comparative benchmarks: https://simonwillison.net/2023/Apr/12/code-interpreter/ https://simonwillison.net/2023/Apr/12/code-interpreter/ You can upload all sorts of weird things to it. I've uploaded .whl wheel files from PyPI to give it extra Python dependencies. I also uploaded a Deno (and a Lua) interpreter and that gave it the ability to write and execute code in JavaScript and Lua! https://til.simonwillison.net/llms/code-interpreter-expansions https://til.simonwillison.net/llms/code-interpreter-expansio...
- ionwake 3y ago
  Great posts thanks
- QuantumGood 3y ago
  How did you get access? I have access to plugins, but not code interpreter
  - TheHumanist 3y ago
    Wondering this as well
  - simonw 3y ago
    Don't know. I was hanging out in the Slack for the Plugins alpha test, which probably helped.

145 points by stuckinhell 3y ago

Microsoft and Google adding LLMs to their ecosystem makes sense. But I don't see Apple adding something similar to MS Copilot to Numbers, Pages, etc. In a way, Apple seems to signal lack of hope for getting into the AI game. Soon, Apple will just be a "commodity" producer[0]: the company that makes the machines in the background, while other pioneers actually provide cutting edge technologies for those machines (e.g., local LLMs). Something like the oil companies, chip industry, etc. Apple will be making the iPhones and Macs and that's about it. They're too conservative to get out of their comfort zone now. In a weird way, it's actually still aligned with their "think different" motto: when everyone is thinking about getting on the AI bandwagon, think different and avoid doing that! [0]: Which is fine—the world needs boring companies as much as pioneers who break things.

moonchrome 3y ago
Or Apple will do what they always do, wait for the tech to mature then buy some big player like anthropic and integrate it into their products.
- behnamoh 3y ago
  Their track record shows if they can't tightly control a technology, they won't touch it. LLMs can be bent in different ways and Apple wouldn't allow that. I own Apple devices, but I just don't see Apple play in the Google/MS/ClosedAI's field by saying "Our model is 20% larger than the best models out there...". Also, Apple should first fix Siri, or get rid of it for good. It's a joke at this point.
  - agloe_dreams 3y ago
    I would argue that Siri is an example of a lightly controlled technology. My bet is that Apple will appear behind for 2-4 years and out of nowhere will launch a Spike Jonze's Her-style "Samantha" that was in R&D for years.
    - sebzim4500 3y ago
      I don't think this is possible. There aren't that many AI researchers and they talk to each other. If Apple was making a serious AI push it would be obvious.
      - noahtallen 3y ago
        There actually have been rumors about this: https://www.macrumors.com/2023/05/22/apple-ramps-up-hiring-of-ai-experts/ https://www.macrumors.com/2023/05/22/apple-ramps-up-hiring-o... (and I remember hearing more before April as well.) I feel like any company which has chatbots as a "core" part of their systems (like Siri is often advertised to be) would be looking very heavily into generative AI. It makes way too much sense and would clearly make Siri way more useful. Imagine if Siri was current ChatGPT with plugins for interacting with the OS -- this immediately solves basically all the complaints about Siri. Plus Apple has efficient local AI acceleration already, which could make it even better. It feels so obvious it'd be weird if they weren't trying to make a better Siri with gen AI! I have a feeling we'll hear about it either at WWDC or the iPhone event in the fall.
        chaxor 3y ago
        They will likely make Siri an LLM but not make a big deal about it. Just simply put it as a minor revision note, because that's effectively all it is.
    - behnamoh 3y ago
      The thing about these technologies is that you can't repeat the same recipe for iPhone. Even 6 months is too long a time for a company to stay behind. The rate of progress in this field, combined with the insane VC money driven up by the hype around LLMs, means that no company can afford "surprising" everyone by waiting just a bit longer. Google did that and see where they are now.
      - noahtallen 3y ago
        You're right, but we're talking about Apple. While they may not be able to introduce a ChatGPT competito, Siri basically has a captive audience. With OS-level integrations, you can easily imagine a much more powerful and interactive Siri which becomes popular just because it's available out of the box and offers OS level integrations which a 3rd party chatbot can't. It's also not like AI tools are why people buy Apple products. So "waiting" probably doesn't cost them much money -- it doesn't impact their core hardware and service revenue. It's "just" a value add for now.
  - sebzim4500 3y ago
    Not convinced. The most useful feature of the first iPhone was it's web browser. Apple had/has very loose control over what people use it for.
    - behnamoh 3y ago
      True, but Apple still controls what web engine you use on iOS and what extensions you can install there.
      - cube2222 3y ago
        Which, according to rumors, will change soon and be announced on WWDC, due to EU regulation.
  - iknowstuff 3y ago
    Siri is great! The on device recognition makes it far more reliable
- wilg 3y ago
  Hardly always their playbook, they rarely make big acquisitions like that. Siri back in the day, Beats, P.A. Semi, are the most notable acquisitions.
  - moonchrome 3y ago
    I was trying to say that they usually don't introduce bleeding edge tech to their products and lag on adoption till the tech is polished enough. For acquisition yeah I was thinking along the lines of Siri.
judge2020 3y ago
To be fair, it often seems like they've forgotten about all of their office apps outside of Keynote.
agloe_dreams 3y ago
The wild bit about this is this: Imagine reading this comment 6 months ago. A person would probably spit their drink out..but it is true. Apple will spend WWDC talking about XR like it is a 2021 Facebook Earnings Call.
- TeMPOraL 3y ago
  Even wilder bit: imagine reading any of this 6 months ago. ChatGPT just came out. It was a fun toy with some potential, but mostly seen as another example of the copilot-y "might make some jobs somewhat different in the mid-term future" tech demo. Who would've thought that in just four months, GPT-4 will completely transform people's perception of AI progress timeline and impact.
headcanon 3y ago
Apple has always been a consumer product-focused company. Even if computing continues to become more invisible and omnipresent, even if we no longer use laptops and phones, there will still be some kind of physical "product" at the end of the day, and thats where Apple will continue to exist. For LLMs, I don't see Apple opening up a general-purpose LLM or search engine like ChatGPT or Bing, its difficult to differentiate themselves in a meaningful way. I can see them developing a unique "personality" to Siri and integrating its behavior into existing devices and APIs. There's still a lot of room between where we are now and a personal AI-buddy like in "Her", so I imagine Apple is at least interested in moving in that direction.
crazygringo 3y ago
It's strange to me that you think Apple will become a "commodity" producer when it has the largest profit margins in the industry. Which is the exact opposite of how commodities function in economics. Yes Apple's focus is hardware as opposed to software, but there is commodity hardware and non-commodity hardware. Apple is firmly in the non-commodity camp and shows no signs of changing. Things like M2 chips are not "commodity". I have no idea what Apple will do with LLM's. But Apple is already leveraging ML in things like built-in local dictation and OCR, and we can probably expect that it will leverage things like LLM's at the OS level (iOS/macOS) rather than focusing on their iWork suite. (Honestly at this point I don't understand Apple's strategic purpose with iWork, or even Final Cut Pro.)
- htss2013 3y ago
  Do the high profits come from the hardware or from rent seeking behavior in the app store and elsewhere?
  - crazygringo 3y ago
    They definitely come from the hardware, I'm talking about profits from the sale of hardware alone. In April 2023, Apple has a 30% market share of smartphones worldwide [1]. And in the first 3 months of 2023, Apple accounted for 50% of global smartphone revenue... and 80 percent of the industry's profits [2]. These is smartphone revenue, not services revenue. (Apple makes money from the App Store too but that's separate.) 80% of industry profit from 30% market share is certainly not a commodity. Cheap Android phones are a commodity. iPhones are the polar opposite. [1] https://www.oberlo.com/statistics/smartphone-market-share#:~:text=The%20latest%20statistics%20on%20the,worldwide%20use%20an%20Apple%20phone https://www.oberlo.com/statistics/smartphone-market-share#:~.... [2] https://www.statista.com/chart/29925/apples-share-of-the-global-smartphone-market/#:~:text=Thanks%20to%20its%20high%20average,first%20three%20months%20of%202023 https://www.statista.com/chart/29925/apples-share-of-the-glo....
alfalfasprout 3y ago
Huh? The reality is "cutting edge" doesn't necessarily mean it's a great product for consumers. Also frankly, productionalizing LLMs is very different from making research strides on them. Even inside Google researchers are realizing that a bulk of the improvements are now coming from the OSS community. Apple will implement these technologies when it makes sense to do so.
- behnamoh 3y ago
  cgpt is already a product that serves consumers very well. No need to “productionalize” it.
rad_gruchalski 3y ago
> Apple will be making the iPhones and Macs and that's about it. They're too conservative to get out of their comfort zone now. Why would Apple even pursue LLMs? They are building hardware: computers, phones, screens, accessories. In a sense, that’s what you said. Just phrasing a question to your thought.

justanotheratom 3y ago

Considering the cost of running these LLMs behind the scenes, and the giant customer base of Office, Windows, Bing, Edge, etc. I wonder how Microsoft will keep things profitable. I guess they can just raise subscription price of Microsoft 365 at some point.

partiallypro 3y ago
Microsoft has tons of cash and on-going profits to be a loss leader for a while, also I imagine they will eventually limit some features to Microsoft 365 users only. They already charge extra for Teams with Copilot, etc; that's not a standard Teams feature. They also announced a "copilot" stack today, which I imagine they will charge for API usage on top of what they are going to be making from ChatGPT.
pixl97 3y ago
With the operating costs of AI at this time, this is going to be the big question for everyone. One of these you can't afford not to have it, but your can't afford to have it either. With all this said, Microsoft/Google/Apple have been sucking up stupid profits for decades now and it really is time for their unlimited money machine to have some pushback.
PeterStuer 3y ago
Same would have been said of running IBM mainframes in the 1970's no?

YousefED 3y ago

What makes me most excited about this is that it uses LLMs in a way that the result (a computer program) is still understandable and editable (hackable). Instead of having an AI model output some kind of "black-box conclusion" on a data set / question, it can output code that we can inspect, improve, and learn from. Using LLMs in this way still keeps us as users "in control" - and I think it's a promising path for responsible AI. I've done some experiments[1] adding ChatGPT-like functionality to my open source Typescript Notebook environment[2] back in december, and hope to revisit this soon :) [1] https://twitter.com/YousefED/status/1599805936280907776 https://twitter.com/YousefED/status/1599805936280907776 [2] https://www.typecell.org/ https://www.typecell.org/

derwiki 3y ago
I completely agree that the best LLM output is something that is still understandable/hackable -- and maybe even _needs_ further hacking. That's what I tell people when they say "I heard AI is replacing programmers."
- whitemary 3y ago
  In the aggregate, it is in fact replacing programmers; just not all of them.

taf2 3y ago

Been using copilot with vim for a few weeks and my only issue has been when the file i'm editing is large the node process goes to like 100% and my typing is severely lagged... i quickly do :Copilot disable and move on with my day but really hoping the performance can improve, it's helpful when it works.

michaelmior 3y ago
You may want to check out Codium[0]. I haven't used Copilot with Vim, but I've never experienced a CPU issue with Codium. Bonus is that it's free! (You would be right to be concerned about the something for nothing here. Personally I was satisfied by their blog post on the subject[1], but of course you need to decide what's right for you.) [0] https://www.codium.com/ https://www.codium.com/ [1] https://codeium.com/blog/how-is-codeium-free https://codeium.com/blog/how-is-codeium-free
- prometheon1 3y ago
  Codium and Codeium are different products

padolsey 3y ago

For me the most awesome thing here is the 100MB file upload function. May sound like nothing, but this is groundbreaking when we've been so far constrained by token limits. This means we don't need to endure an arduous back-and-forth process of giving it tiny pieces of data, code, and increasingly creative prompts. It can now just injest an entire dataset or software project and make swathing changes of all manner. This is going to disrupt everything (and already is..). I'm left wondering what the role of a software eng is and all I can come up with is a glorified quality analyst. Nothing wrong with that, but it's just such a transformation, and so sudden. I'm excited, scared, and exhausted all at the same time!

JohnFen 3y ago
> Nothing wrong with that Unless, of course, you want to be a software engineer. If all there is to my career is checking generated code for correctness, then there is nothing of value in my career anymore. That's not how it will be, though. At worst, there will still be niches I can fit in.
- fbrncci 3y ago
  I could imagine that we will probably be checking generated code for correcteness while integrating larger parts of generated code. And due to the sheer complexity will need an en engineering understanding to make it all work. I’m excited for that, because it means I can do more with my time. But I also understand how that is not everyone’s cup of tea. > Unless, of course, you want to be a software engineer. It’s time to adapt to a changing world.
  - JohnFen 3y ago
    > I could imagine that we will probably be checking generated code for correcteness while integrating larger parts of generated code. So we're all to become systems integrators? I'm genuinely happy that excites you. Personally, I find the prospect depressing. > It’s time to adapt to a changing world. How do you adapt to no longer being able to do what you love to do? Saying "it's time to adapt" doesn't address the fundamental issue here at all. Obviously, we have to adapt. The question is how to do that and, if happiness is no longer on the table, at least be able to maintain some amount of career satisfaction. If I can't write software, then my career as a dev is over, no?

occamschainsaw 3y ago

I really want to try the code interpreter. I got access to the plugins early but there was no browsing and interpreter. Then I got access to browsing when they released it widely last week. Does anybody know how to get access to the code interpreter? I have lost track of all the ${LLM_Service} waitlists I have signed up for.

RecycledEle 3y ago
Same here.i also want the upload feature, which MY ChatGPT Plus lacks.

anotherpaulg 3y ago

In shameless attempt to raise awareness about my open source gpt-4 coding tool "aider" [1], I replicated the author's US Census data analysis example from the command line. This doesn't require the beta ChatGPT plugins, just a gpt-4 api key. You can see in the chat transcript [2] that I had GPT-4 tell me how to download census data, suggest some hypotheses to test, test one, summarize the results and plot a graph. As we went along, I had it write the code for all that as a python script in my local git repo. [1] https://github.com/paul-gauthier/aider https://github.com/paul-gauthier/aider [2] https://aider.chat/examples/census.html https://aider.chat/examples/census.html

Tostino 3y ago
Getting an API key has been just a waiting game here... Not been approved through work or personally yet after almost 3 months. I already have plugin access though, it's...alright. The web browsing leaves a ton to be desired.
- anotherpaulg 3y ago
  Ya, I'm not sure why I got lucky to receive one. For coding tasks, gpt-4 really is significantly better than 3.5. I've been building tools for coding with GPT for a few months now, and they got way more effective and reliable with gpt-4.
- TheHumanist 3y ago
  The thing I've used browsing for the most is linking to lengthy markdown files for large initial prompts with heavy detail. It works alright. Not perfect but decent.

oidar 3y ago

https://archive.is/20230504163052/https://www.oneusefulthing.org/p/it-is-starting-to-get-strange https://archive.is/20230504163052/https://www.oneusefulthing...

loudmax 3y ago

I wonder about the copyright status of code put out by ChatGPT. I presume anything ChatGPT generates belongs to the user who asked for the code to be generated. Is there any clause in the EULA that says this is the case? Or is code generated by ChatGPT automatically BSD-licensed? Or can ChatGPT claim ownership or joint-ownership of code generated using their tools? Another question is the code it was trained on. Presumably all of it was open source. BSD-licensed code typically requires attribution. GPL code requires anything copied to remain GPL. If the GPT is reproducing small stanzas of code from memory it probably doesn't matter. If GPT reproduces larger blocks of code from stuff that it was trained on, there is a possibility of failing to comply with copyright.

JohnFen 3y ago
> I presume anything ChatGPT generates belongs to the user who asked for the code to be generated. Machine generated works cannot be copyrighted, only human-created works. The part here that has yet to be determined is whether or not AI output is considered "machine generated". An argument could be made that writing a prompt is sufficient control to consider the output human-made for the purposes of copyright. If that's the case, then copyright will go to the human who wrote the prompt (or their employer). This will, at some point, have to be decided in court. Right now, the only answer is "nobody knows".
- randyrand 3y ago
  Photographers own their images, even if the scene was set up by someone else. Pushing a button is sufficient to own copyright, in theory.
  - JohnFen 3y ago
    Right, which is why I think that courts will end up deciding that writing a prompt is sufficient control. But as of this moment, none of this has been decided -- so nobody actually knows.
  - lewhoo 3y ago
    I think in this case the product is the scene and not the picture though. If one could copyright the result of a prompt then I assume no one else could use the same (or very similar) prompt for profit as it is likely to produce similar code whereas a scene can be photographed for profit by anyone regardless if a similar picture has already been taken, or so I assume. If Andy Warhol just photographed Prince in a same/similar pose and clothes would there be the lawsuit case ? I don't think so.

simonw 3y ago

ChatGPT Code Interpreter really is incredibly useful. In addition to data analysis stuff, I've also used it for running comparative benchmarks: https://simonwillison.net/2023/Apr/12/code-interpreter/ https://simonwillison.net/2023/Apr/12/code-interpreter/ You can upload all sorts of weird things to it. I've uploaded .whl wheel files from PyPI to give it extra Python dependencies. I also uploaded a Deno (and a Lua) interpreter and that gave it the ability to write and execute code in JavaScript and Lua! https://til.simonwillison.net/llms/code-interpreter-expansions https://til.simonwillison.net/llms/code-interpreter-expansio...

ionwake 3y ago
Great posts thanks
QuantumGood 3y ago
How did you get access? I have access to plugins, but not code interpreter
- TheHumanist 3y ago
  Wondering this as well
- simonw 3y ago
  Don't know. I was hanging out in the Slack for the Plugins alpha test, which probably helped.