4 ms·

Have you tried using Ollama? You can download and run an LLM locally on your machine. You can also pick the right model for the right need and it's free.

mentos 2y ago
I’m using ChatGPT4o to convert a C# project to C++. Any recommendation on what Ollama model I could use instead?
- neonsunset 2y ago
  The one that does not convert C# at all and asks you to just optimize it in C# instead (and to use the appropriate build option) :D
  - mentos 2y ago
    I’m converting game logic from C# to UE5 C++. So far made great progress using ChatGPT4o and o1
    - neonsunset 2y ago
      Do you find these working out better for you than Claude 3.5 Sonnet? So far I've not been a fan of the ChatGPT models' output.
      - mentos 2y ago
        I find ChatGPT better with UE4/5 C++ but they are very close. Biggest advantage is the o1 128k context. I can one shot an entire 1000 line class where normally I’d have to go function by function with 4o.
brabel 2y ago
Yes. If the AI is not integrated with the IDE, it's not as helpful. If there were an IDE plugin that let you use a local model, perhaps that would be an option, but I haven't seen that (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?).
- antifa 2y ago
  > If there were an IDE plugin that let you use a local model TabbyML
- oogali 2y ago
  It’s doable as it’s what I use to experiment. Ollama + CodeGPT IntelliJ plugin. It allows you to point at a local instance.
  - mark_l_watson 2y ago
    I also use Ollama for coding. I have a 32G M2 Mac, and the models I can run are very useful for coding and debugging, as well as data munging, etc. That said, sometimes I also use Claude Sonnet 3.5 and o1. (BTW, I just published an Ollama book yesterday, so I am a little biassed towards local models.)
    - matrix12 2y ago
      Thanks for the book!
- bpizzi 2y ago
  > (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?). To my knowledge, it doesn't. On Emacs there's gptel which integrates quiet nicely different LLM inside Emacs, including a local Ollama. > gptel is a simple Large Language Model chat client for Emacs, with support for multiple models and backends. It works in the spirit of Emacs, available at any time and uniformly in any buffer. https://github.com/karthink/gptel https://github.com/karthink/gptel
- th4t1sW13rd 2y ago
  This can use Ollama: https://www.continue.dev/ https://www.continue.dev/

mentos 2y ago

I’m using ChatGPT4o to convert a C# project to C++. Any recommendation on what Ollama model I could use instead?

neonsunset 2y ago
The one that does not convert C# at all and asks you to just optimize it in C# instead (and to use the appropriate build option) :D
- mentos 2y ago
  I’m converting game logic from C# to UE5 C++. So far made great progress using ChatGPT4o and o1
  - neonsunset 2y ago
    Do you find these working out better for you than Claude 3.5 Sonnet? So far I've not been a fan of the ChatGPT models' output.
    - mentos 2y ago
      I find ChatGPT better with UE4/5 C++ but they are very close. Biggest advantage is the o1 128k context. I can one shot an entire 1000 line class where normally I’d have to go function by function with 4o.

brabel 2y ago

Yes. If the AI is not integrated with the IDE, it's not as helpful. If there were an IDE plugin that let you use a local model, perhaps that would be an option, but I haven't seen that (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?).

antifa 2y ago
> If there were an IDE plugin that let you use a local model TabbyML
oogali 2y ago
It’s doable as it’s what I use to experiment. Ollama + CodeGPT IntelliJ plugin. It allows you to point at a local instance.
- mark_l_watson 2y ago
  I also use Ollama for coding. I have a 32G M2 Mac, and the models I can run are very useful for coding and debugging, as well as data munging, etc. That said, sometimes I also use Claude Sonnet 3.5 and o1. (BTW, I just published an Ollama book yesterday, so I am a little biassed towards local models.)
  - matrix12 2y ago
    Thanks for the book!
bpizzi 2y ago
> (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?). To my knowledge, it doesn't. On Emacs there's gptel which integrates quiet nicely different LLM inside Emacs, including a local Ollama. > gptel is a simple Large Language Model chat client for Emacs, with support for multiple models and backends. It works in the spirit of Emacs, available at any time and uniformly in any buffer. https://github.com/karthink/gptel https://github.com/karthink/gptel
th4t1sW13rd 2y ago
This can use Ollama: https://www.continue.dev/ https://www.continue.dev/