9 ms·

iTerm2 feature request: disable all AI-related features

66 points by merelysounds 2y ago

planetf1 2y ago
[dead]
coldtea 2y ago
Amen!
righthand 2y ago
From the release notes[0]: AI == - Add AI-powered natural language command generation. Enter a prompt in the composer and select Edit > Engage Artificial Intelligence. You will need to provide an OpenAI API key since GPT costs money to use. - A new AI feature in the Toolbelt, "Codecierge", lets you set a goal and then walks you step-by-step to completing it by watching the terminal contents. It requires you to supply an OpenAI API key. [0] https://iterm2.com/downloads/stable/iTerm2-3_5_0.changelog https://iterm2.com/downloads/stable/iTerm2-3_5_0.changelog
- StrLght 2y ago
  > You will need to provide an OpenAI API key since GPT costs money to use. Basically there's no "AI feature" enabled by default then, right? What are all these people talking about in the issue then? I am so confused.
  - deleted 2y ago
    [deleted]
  - spartanatreyu 2y ago
    A big problem for a lot of devs is that even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI. Which begs the question: what happens when any key (even an invalid one) gets added to iTerm for any reason (e.g. dark pattern, settings export/import, buggy update, accident, forgetting to remove an old key, a sentinel message saying: "do not use AI in this department", etc...). Besides that there's other issues, - What happens if the training data is poisoned to compromise developers machines with a `curl ... | sh`? - What about developers who can no longer use the tool due to policies/regulations that rule out products with LLM features, or a feature that has the potential to send data to a third party? - What happens if the LLM hallucinates an env variable's value/existence and what should be a simple `rm -rf $BUILD/` turns into `rm -rf /` when $BUILD is not defined? I'm sure there's more concerns too.
    - ehPReth 2y ago
      is it? I thought you had to specifically invoke and prompt something? not just it sending everything carte blanche?
    - lurkersince2013 2y ago
      | "A big problem for a lot of devs is that even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI." ...uh why on earth would it be doing this? Do you have any evidence this behavior is happening? OpenAI integration is disabled by default, you have to actively enable it before it will send anything to OpenAI's servers.
    - StrLght 2y ago
      > <...> even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI. Could you please point me to the code (or provide any other proof that this is happening)? This seems either insane or like a huge bug, so I have a hard time taking anyone's word for it.
mdeeks 2y ago
I'm really confused what is going on here with people being so upset. It doesn't do anything unless you provide an OpenAI key. Nothing is sent anywhere unless you actually run the "Engage Artificial Intelligence" command. It's roughly the same thing as asking ChatGPT, but its right in your terminal app. It isn't always on or anything. It's actually kind of hard to find and use. Is there maybe something I'm missing? Or is this a general backlash against AI?
- tflol 2y ago
  yeah youre missing that this suggests all usage is suddenly being used for training. the incentive for the company is avoiding suffering the opportunity cost of not using user data for training. the aggression of this post is weirder than the aggression of the opposition. edit: several rephrases of the middle sentence
  - mdeeks 2y ago
    If it does do that then yeah, there should be backlash. But I don't see that stated anywhere in the notes nor do I see a hint of that in the app. The only two AI interfaces I see are the "Engage Artificial Intelligence" menu item where you ask it how to form a command, and then a second interface in the Toolbelt called Codecierge where it tries to complete a task you tell it to do. Both of which are completely optional and require an OpenAI key. If you do use them you're sending your request to OpenAI but as far as I can tell it doesn't get any of your command history or anything like that.
    - tflol 2y ago
      > If it does do that then yeah, there should be backlash. It's a threat. Disrespectful to users. Maybe it does, maybe it doesn't! If it doesn't maybe it will someday! When just the right person gets hired into exec.
    - upon_drumhead 2y ago
      The API key is unvalidated and so any entry that isn't exactly a blank string is treated like a valid key and data is sent out. There's a risk there that a future version may handle the blank key incorrectly or differently and start transmitting away. For some people, the possibility of a string handling bug or a filesystem corruption or what not is enough of a risk to avoid the software.
Me1000 2y ago
This is an opt-in feature, so by defaut all AI-related features are disabled. You have to go out of your way to generate an API key and add it, it's not even a thing you could accidentally turn on. And if you'd like to use the features without sending your prompts to OpenAI, under the advanced settings you can supply any OpenAI compatible API URL (if you're running an LLM locally for privacy reasons for example).
dangrief 2y ago
[flagged]
deleted 2y ago
[deleted]
doctorpangloss 2y ago
This comment will be about the reasons people don't like this feature, but without restating the obvious. > having AI in my terminal is a deal-breaker. Okay. > I’ll be liable for breaching my NDA if that gets sent to some network service. Right... > government regulatory requirements prohibit the use of software with so-called "AI" features for certain tasks Sure... > Hate to be that guy, but it is not configured by default, not disabled. It should be disableable feature even if OpenAI key is entered, for example. Uh huh... > Similar working position to Tom N & Matt B above, I'm working in an organisation where any knowledge of our products must not be allowed to leak within or outside the company. Right Stephen, sure, how did we not think of that... > I rolled back the update on my end, but my pihole shows some openai queries from my Mac. It's hard to say whether it was iTerm o not as I use chat gpt on the browser. Hmmm... I don't really know the specifics of the feature, I don't use iTerm2. It sounds like you can opt-in (I'm going to avoid using the word enable or configure) to a feature that uses OpenAI's API to auto-complete terminal commands. It's a macOS application, these users visit the wider Internet, they are already receiving personalized Apple and Google networked experiences, they are already sending a lot of telemetry. Let's suppose OpenAI, like Apple and Google, makes a good-faith effort to protect your data and keeps its promises about not using API driven calls for training in a way that could leak private information to other OpenAI users. Don't litigate this, there's nothing to serve in the interest of curiosity here. Is there an objective, secular, non-vibes basis for being this pissed off about a new feature? Why do people draw the line at some kinds of telemetry, but not others?
- elicksaur 2y ago
  You’re very dismissive of the reasons the people are stating. An “objective, secular, non-vibes” approach would be taking people at their word.
sondr3 2y ago
I too would be immensely frustrated if this was released in my terminal emulator, and would jump ship immediately. My current job would (and probably will) ban this and similar integrations unless compliance gives the thumbs up... and they do not care about how optional it is. GitHub Copilot is still not allowed unless you are in a small pilot project with their own agreement and contract for sharing and storage with Microsoft with tons of red tape. ChatGPT is still banned. Please keep AI out of the core features of applications that absolutely don't need it.
- weikju 2y ago
  I wonder how they'll react to the next version of macOS, iOS and Windows...
lurkersince2013 2y ago
So here we have a bunch of people complaining about a useful feature that has been written and included for them to use free of charge in an open source project that they themselves likely use to help them earn money at their workplaces... Wonder if these people ever gave the author any credit for the countless other features he wrote for them that they've enjoyed for years, or if they only come here to complain. I suspect most of them haven't. Really an amazing amount of entitlement on display. There's a reason many of us use iTerm2.app over Terminal.app... But Terminal.app is always right there if you prefer your terminal without any features. This really isn't something to be so upset about.
ChrisArchitect 2y ago
Related: iTerm2 and AI Hype Overload https://news.ycombinator.com/item?id=40432446 https://news.ycombinator.com/item?id=40432446
drivingmenuts 2y ago
There is other terminal software out there for the Mac. I haven’t really tested any of it; I’m fine with iterm2. I can avoid the whole AI issue by just not supplying a key for openAI.

66 points by merelysounds 2y ago

planetf1 2y ago

[dead]

coldtea 2y ago

Amen!

righthand 2y ago

From the release notes[0]: AI == - Add AI-powered natural language command generation. Enter a prompt in the composer and select Edit > Engage Artificial Intelligence. You will need to provide an OpenAI API key since GPT costs money to use. - A new AI feature in the Toolbelt, "Codecierge", lets you set a goal and then walks you step-by-step to completing it by watching the terminal contents. It requires you to supply an OpenAI API key. [0] https://iterm2.com/downloads/stable/iTerm2-3_5_0.changelog https://iterm2.com/downloads/stable/iTerm2-3_5_0.changelog

StrLght 2y ago
> You will need to provide an OpenAI API key since GPT costs money to use. Basically there's no "AI feature" enabled by default then, right? What are all these people talking about in the issue then? I am so confused.
- deleted 2y ago
  [deleted]
- spartanatreyu 2y ago
  A big problem for a lot of devs is that even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI. Which begs the question: what happens when any key (even an invalid one) gets added to iTerm for any reason (e.g. dark pattern, settings export/import, buggy update, accident, forgetting to remove an old key, a sentinel message saying: "do not use AI in this department", etc...). Besides that there's other issues, - What happens if the training data is poisoned to compromise developers machines with a `curl ... | sh`? - What about developers who can no longer use the tool due to policies/regulations that rule out products with LLM features, or a feature that has the potential to send data to a third party? - What happens if the LLM hallucinates an env variable's value/existence and what should be a simple `rm -rf $BUILD/` turns into `rm -rf /` when $BUILD is not defined? I'm sure there's more concerns too.
  - ehPReth 2y ago
    is it? I thought you had to specifically invoke and prompt something? not just it sending everything carte blanche?
  - lurkersince2013 2y ago
    | "A big problem for a lot of devs is that even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI." ...uh why on earth would it be doing this? Do you have any evidence this behavior is happening? OpenAI integration is disabled by default, you have to actively enable it before it will send anything to OpenAI's servers.
  - StrLght 2y ago
    > <...> even with an invalid API key, iTerm2 is still sending everything that happens in the terminal to OpenAI. Could you please point me to the code (or provide any other proof that this is happening)? This seems either insane or like a huge bug, so I have a hard time taking anyone's word for it.

mdeeks 2y ago

I'm really confused what is going on here with people being so upset. It doesn't do anything unless you provide an OpenAI key. Nothing is sent anywhere unless you actually run the "Engage Artificial Intelligence" command. It's roughly the same thing as asking ChatGPT, but its right in your terminal app. It isn't always on or anything. It's actually kind of hard to find and use. Is there maybe something I'm missing? Or is this a general backlash against AI?

tflol 2y ago
yeah youre missing that this suggests all usage is suddenly being used for training. the incentive for the company is avoiding suffering the opportunity cost of not using user data for training. the aggression of this post is weirder than the aggression of the opposition. edit: several rephrases of the middle sentence
- mdeeks 2y ago
  If it does do that then yeah, there should be backlash. But I don't see that stated anywhere in the notes nor do I see a hint of that in the app. The only two AI interfaces I see are the "Engage Artificial Intelligence" menu item where you ask it how to form a command, and then a second interface in the Toolbelt called Codecierge where it tries to complete a task you tell it to do. Both of which are completely optional and require an OpenAI key. If you do use them you're sending your request to OpenAI but as far as I can tell it doesn't get any of your command history or anything like that.
  - tflol 2y ago
    > If it does do that then yeah, there should be backlash. It's a threat. Disrespectful to users. Maybe it does, maybe it doesn't! If it doesn't maybe it will someday! When just the right person gets hired into exec.
  - upon_drumhead 2y ago
    The API key is unvalidated and so any entry that isn't exactly a blank string is treated like a valid key and data is sent out. There's a risk there that a future version may handle the blank key incorrectly or differently and start transmitting away. For some people, the possibility of a string handling bug or a filesystem corruption or what not is enough of a risk to avoid the software.

Me1000 2y ago

This is an opt-in feature, so by defaut all AI-related features are disabled. You have to go out of your way to generate an API key and add it, it's not even a thing you could accidentally turn on. And if you'd like to use the features without sending your prompts to OpenAI, under the advanced settings you can supply any OpenAI compatible API URL (if you're running an LLM locally for privacy reasons for example).

dangrief 2y ago

[flagged]

deleted 2y ago

[deleted]

doctorpangloss 2y ago

This comment will be about the reasons people don't like this feature, but without restating the obvious. > having AI in my terminal is a deal-breaker. Okay. > I’ll be liable for breaching my NDA if that gets sent to some network service. Right... > government regulatory requirements prohibit the use of software with so-called "AI" features for certain tasks Sure... > Hate to be that guy, but it is not configured by default, not disabled. It should be disableable feature even if OpenAI key is entered, for example. Uh huh... > Similar working position to Tom N & Matt B above, I'm working in an organisation where any knowledge of our products must not be allowed to leak within or outside the company. Right Stephen, sure, how did we not think of that... > I rolled back the update on my end, but my pihole shows some openai queries from my Mac. It's hard to say whether it was iTerm o not as I use chat gpt on the browser. Hmmm... I don't really know the specifics of the feature, I don't use iTerm2. It sounds like you can opt-in (I'm going to avoid using the word enable or configure) to a feature that uses OpenAI's API to auto-complete terminal commands. It's a macOS application, these users visit the wider Internet, they are already receiving personalized Apple and Google networked experiences, they are already sending a lot of telemetry. Let's suppose OpenAI, like Apple and Google, makes a good-faith effort to protect your data and keeps its promises about not using API driven calls for training in a way that could leak private information to other OpenAI users. Don't litigate this, there's nothing to serve in the interest of curiosity here. Is there an objective, secular, non-vibes basis for being this pissed off about a new feature? Why do people draw the line at some kinds of telemetry, but not others?

elicksaur 2y ago
You’re very dismissive of the reasons the people are stating. An “objective, secular, non-vibes” approach would be taking people at their word.

sondr3 2y ago

I too would be immensely frustrated if this was released in my terminal emulator, and would jump ship immediately. My current job would (and probably will) ban this and similar integrations unless compliance gives the thumbs up... and they do not care about how optional it is. GitHub Copilot is still not allowed unless you are in a small pilot project with their own agreement and contract for sharing and storage with Microsoft with tons of red tape. ChatGPT is still banned. Please keep AI out of the core features of applications that absolutely don't need it.

weikju 2y ago
I wonder how they'll react to the next version of macOS, iOS and Windows...

lurkersince2013 2y ago

So here we have a bunch of people complaining about a useful feature that has been written and included for them to use free of charge in an open source project that they themselves likely use to help them earn money at their workplaces... Wonder if these people ever gave the author any credit for the countless other features he wrote for them that they've enjoyed for years, or if they only come here to complain. I suspect most of them haven't. Really an amazing amount of entitlement on display. There's a reason many of us use iTerm2.app over Terminal.app... But Terminal.app is always right there if you prefer your terminal without any features. This really isn't something to be so upset about.

ChrisArchitect 2y ago

Related: iTerm2 and AI Hype Overload https://news.ycombinator.com/item?id=40432446 https://news.ycombinator.com/item?id=40432446

drivingmenuts 2y ago

There is other terminal software out there for the Mac. I haven’t really tested any of it; I’m fine with iterm2. I can avoid the whole AI issue by just not supplying a key for openAI.