4 ms·

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally https://ollama.ai/blog/run-code-llama-locally Mo

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama https://ollama.ai/library/codellama

deleted 3y ago
[deleted]
syntaxing 3y ago
Whoa, it’s absolutely astounding how fast the community is reacting to these model release!
jerrysievert 3y ago
while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest) my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.
- carbocation 3y ago
  Similarly, I had it emit hundreds of blank lines before cancelling it.
  - kordlessagain 3y ago
    What fortune, I so happen to need hundreds of blank lines.
  - justinsaccount 3y ago
    Maybe it's outputting https://en.wikipedia.org/wiki/Whitespace_(programming_language) https://en.wikipedia.org/wiki/Whitespace_(programming_langua... :-)
- syntaxing 3y ago
  Same, just tried it and it would give me infinite amount of blank lines
  - jmorgan 3y ago
    Sorry, this should be fixed now! To update you'll have to run: ollama pull codellama:7b-instruct
    - pmayrgundter 3y ago
      This is amazing! I was up and running from clone/build-from-scratch/download in ~5m. It's running on my M1.. it knows WebGL JS APIs better than I do, makes a passable attempt at VT100 ascii art, and well, should read more about Wolfram Automata, but does seem to know Game of Life! Thank you so much!
- mchiang 3y ago
  still modifying the code completion (foundation / python models) to see what's causing the behavior. Have had some good success with the instruct model: codellama:7b-instruct
  - jerrysievert 3y ago
    thanks! this give me some results, but I've had to use a specific construct to get anything meaningful: using <language> write me a <thing> it's managed to spit out code, rather than "write a traversal function".
  - ranguna 3y ago
    Nice work with ollama! Any plans to add the 13B quant models?
- jmorgan 3y ago
  > managed to get infinite streams of near nonsense This should be fixed now! To update you'll have to run: ollama pull codellama:7b-instruct
Pesthuf 3y ago
Isn't ollama terminal only? For code, that wouldn't be good.
- natrys 3y ago
  They have a server/client model. The binary comes with a basic terminal front-end but you can just create your own self-hosted GUI or editor integration against the API[1]: [1] https://github.com/jmorganca/ollama/blob/main/docs/api.md https://github.com/jmorganca/ollama/blob/main/docs/api.md
  - jmorgan 3y ago
    Indeed! After pulling a model with "ollama pull codellama" you can access it via the REST API: curl -X POST http://localhost:11434/api/generate -d '{ "model": "codellama", "prompt":"write a python script to add two numbers" }'
- TheLegace 3y ago
  There is also ollama-ui. https://github.com/ollama-ui/ollama-ui https://github.com/ollama-ui/ollama-ui
comechao 3y ago
I'm testing it on my M2 Air (16GB). Quite fast!

deleted 3y ago

[deleted]

syntaxing 3y ago

Whoa, it’s absolutely astounding how fast the community is reacting to these model release!

jerrysievert 3y ago

while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest) my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.

carbocation 3y ago
Similarly, I had it emit hundreds of blank lines before cancelling it.
- kordlessagain 3y ago
  What fortune, I so happen to need hundreds of blank lines.
- justinsaccount 3y ago
  Maybe it's outputting https://en.wikipedia.org/wiki/Whitespace_(programming_language) https://en.wikipedia.org/wiki/Whitespace_(programming_langua... :-)
syntaxing 3y ago
Same, just tried it and it would give me infinite amount of blank lines
- jmorgan 3y ago
  Sorry, this should be fixed now! To update you'll have to run: ollama pull codellama:7b-instruct
  - pmayrgundter 3y ago
    This is amazing! I was up and running from clone/build-from-scratch/download in ~5m. It's running on my M1.. it knows WebGL JS APIs better than I do, makes a passable attempt at VT100 ascii art, and well, should read more about Wolfram Automata, but does seem to know Game of Life! Thank you so much!
mchiang 3y ago
still modifying the code completion (foundation / python models) to see what's causing the behavior. Have had some good success with the instruct model: codellama:7b-instruct
- jerrysievert 3y ago
  thanks! this give me some results, but I've had to use a specific construct to get anything meaningful: using <language> write me a <thing> it's managed to spit out code, rather than "write a traversal function".
- ranguna 3y ago
  Nice work with ollama! Any plans to add the 13B quant models?
jmorgan 3y ago
> managed to get infinite streams of near nonsense This should be fixed now! To update you'll have to run: ollama pull codellama:7b-instruct

Pesthuf 3y ago

Isn't ollama terminal only? For code, that wouldn't be good.

natrys 3y ago
They have a server/client model. The binary comes with a basic terminal front-end but you can just create your own self-hosted GUI or editor integration against the API[1]: [1] https://github.com/jmorganca/ollama/blob/main/docs/api.md https://github.com/jmorganca/ollama/blob/main/docs/api.md
- jmorgan 3y ago
  Indeed! After pulling a model with "ollama pull codellama" you can access it via the REST API: curl -X POST http://localhost:11434/api/generate -d '{ "model": "codellama", "prompt":"write a python script to add two numbers" }'
TheLegace 3y ago
There is also ollama-ui. https://github.com/ollama-ui/ollama-ui https://github.com/ollama-ui/ollama-ui

comechao 3y ago

I'm testing it on my M2 Air (16GB). Quite fast!