4 ms·

would be awesome if this used a local llm. there are several open ones on hugging face fund for terminal command help with low parameters. I'm thinking somethin

would be awesome if this used a local llm. there are several open ones on hugging face fund for terminal command help with low parameters. I'm thinking something like llamafile would be awesome to ship with this app cross platform (though iterm2 specifically could probably assume apple silicon architecture support only). Benefits would be - no external dependencies (OpenAI payment, network availability...) - no data leaving my device - it could deeply learn my configs and filesystem to give specific commands as opposed to general guidance (I know you can embed and send to OpenAI but I'd really not want to share all my hard drive)

mmastrac 2y ago
It appears to be configurable: DEFINE_STRING(aitermURL, @"https://api.openai.com/v1/completions https://api.openai.com/v1/completions", SECTION_EXPERIMENTAL @"URL for AI API.\nA ChatGPT API endpoint should be here. Note that this URL is only used if the model name does not begin with `gpt-` because those models used an older API."); https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc55c68c0dd28d6e70b3433/sources/iTermAdvancedSettingsModel.m#L768 https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc5...
- saghul 2y ago
  I tried it but I get an error: "There was a problem with the AI query: Error from OpenAI: [] is too short - 'messages'" According to the docs it only uses that if the model doesn't begin tieh gpt- and uses an old API, so alas it doesn't seem compatible with ollama. Edit: here is the relevant part of the code: https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc55c68c0dd28d6e70b3433/sources/AITerm.swift#L518 https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc5... Looks like adding ollama support is really a matter of changing a few lines of code. Edit 2: Seems to be fixed in the next beta release: https://github.com/gnachman/iTerm2/commit/fcd212490626f1d8ea975ba444a1ea735a4ad859 https://github.com/gnachman/iTerm2/commit/fcd212490626f1d8ea...
deleted 2y ago
[deleted]

mmastrac 2y ago

It appears to be configurable: DEFINE_STRING(aitermURL, @"https://api.openai.com/v1/completions https://api.openai.com/v1/completions", SECTION_EXPERIMENTAL @"URL for AI API.\nA ChatGPT API endpoint should be here. Note that this URL is only used if the model name does not begin with `gpt-` because those models used an older API."); https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc55c68c0dd28d6e70b3433/sources/iTermAdvancedSettingsModel.m#L768 https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc5...

saghul 2y ago
I tried it but I get an error: "There was a problem with the AI query: Error from OpenAI: [] is too short - 'messages'" According to the docs it only uses that if the model doesn't begin tieh gpt- and uses an old API, so alas it doesn't seem compatible with ollama. Edit: here is the relevant part of the code: https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc55c68c0dd28d6e70b3433/sources/AITerm.swift#L518 https://github.com/gnachman/iTerm2/blob/a196d31658a8d0aa2dc5... Looks like adding ollama support is really a matter of changing a few lines of code. Edit 2: Seems to be fixed in the next beta release: https://github.com/gnachman/iTerm2/commit/fcd212490626f1d8ea975ba444a1ea735a4ad859 https://github.com/gnachman/iTerm2/commit/fcd212490626f1d8ea...

deleted 2y ago

[deleted]