4 ms·

It really is good. Surprisingly it seems to answer instruct-like prompts well! I’ve been using it with Ollama (https://github.com/jmorganca/ollama https://githu

It really is good. Surprisingly it seems to answer instruct-like prompts well! I’ve been using it with Ollama (https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama) with prompts like: ollama run phind-codellama "write c code to reverse a linked list" To run this on an m1 Mac or similar machine, you'll need around 32GB of memory for the 4-bit quantized version since it's a 34B parameter model and is quite big (20GB).

praveenhm 3y ago
Is reverse a linked list is still a popular question on interview?
- ddalex 3y ago
  I ask it as a warmup question, I expect it to be done in 5-10 minutes. Then comes the real question, which is "let's write fizz buzz so it generates at above 55Gbytes/second".
  - moffkalast 3y ago
    Well I'm out of ideas: https://chat.openai.com/share/3883332d-511a-404d-9d5a-7f63f9d63e80 https://chat.openai.com/share/3883332d-511a-404d-9d5a-7f63f9...
    - robinson7d 3y ago
      I believe they’re referencing this codegolf entry: https://codegolf.stackexchange.com/questions/215216/high-throughput-fizz-buzz/236630#236630 https://codegolf.stackexchange.com/questions/215216/high-thr... Previously discussed here on HN: https://news.ycombinator.com/item?id=29031488 https://news.ycombinator.com/item?id=29031488
      - moffkalast 3y ago
        Ah, lmao
    - redox99 3y ago
      Kind of hilarious what it would go for Python, of all languages.
      - pmarreck 3y ago
        I explicitly instructed in my custom instructions to never use Python, Go or JS, and to stick to functional languages. Works a treat.
  - madduci 3y ago
    just out of curiosity, how performed the candidates on real tasks on the job then?
  - fb03 3y ago
    I got that fizzbuzz reference. Stack Overflow thread right?
codetrotter 3y ago
How do you guys get it to run? I tried with ollama, installed from Homebrew, on my M1 Max with 64GB RAM. I downloaded the phind-codellama model using ollama pull phind-codellama But when I give it a prompt, for example ollama run phind-codellama "write a production grade implementation of Sieve of Eratosthenes in Rust" It prints the following error message Error: Post "http://localhost:11434/api/generate": EOF and exits. Even though it worked to run ollama with some other models. Is the version in homebrew not able to run phind-codellama?
- jmorgan 3y ago
  Yes you'll need the latest version (0.0.16) to run the 34B model. It should run great on that machine! The download (both as a Mac app and standalone binary) is available here: https://github.com/jmorganca/ollama/releases/tag/v0.0.16 https://github.com/jmorganca/ollama/releases/tag/v0.0.16. And I will work on getting that brew formula updated as well! Sorry to see you hit an error!
  - JoelJacobson 3y ago
    Is there a limit on the number of lines/tokens it can take as input? Can it be increased? The limit seems to be somewhere above 30 lines. I'm on a MacBook Pro M1 Max 64GB. % ollama --version ollama version 0.0.16 % ollama run phind-codellama "$(cat prompt.txt)" ⠧ Error: Post "http://localhost:11434/api/generate": EOF % wc prompt.txt 335 1481 11457 prompt.txt
    - syntaxing 3y ago
      This feature was surprisingly hard to find, but you can wrap multi line in “””. So start off with “””, then type or new line (with enter) anything you want, then close with “”” and it’ll run the whole prompt. (“”” is 3 parenthesis quote, the formatting from HN is making it look funny)
      - jquery 3y ago
troupo 3y ago
> It really is good > write c code to reverse a linked list The number of times I had to do it in real production code amounts to zero. The number of times I had to piece code from poorly documented external services, conflicting product requirements, and running on complex and weird environments has been ... well ... multiple times a day for the past 20+ years. "instruct-like prompts" is what you give a very junior engineer out of college, and then you have to carefully review their code.

praveenhm 3y ago

Is reverse a linked list is still a popular question on interview?

ddalex 3y ago
I ask it as a warmup question, I expect it to be done in 5-10 minutes. Then comes the real question, which is "let's write fizz buzz so it generates at above 55Gbytes/second".
- moffkalast 3y ago
  Well I'm out of ideas: https://chat.openai.com/share/3883332d-511a-404d-9d5a-7f63f9d63e80 https://chat.openai.com/share/3883332d-511a-404d-9d5a-7f63f9...
  - robinson7d 3y ago
    I believe they’re referencing this codegolf entry: https://codegolf.stackexchange.com/questions/215216/high-throughput-fizz-buzz/236630#236630 https://codegolf.stackexchange.com/questions/215216/high-thr... Previously discussed here on HN: https://news.ycombinator.com/item?id=29031488 https://news.ycombinator.com/item?id=29031488
    - moffkalast 3y ago
      Ah, lmao
  - redox99 3y ago
    Kind of hilarious what it would go for Python, of all languages.
    - pmarreck 3y ago
      I explicitly instructed in my custom instructions to never use Python, Go or JS, and to stick to functional languages. Works a treat.
- madduci 3y ago
  just out of curiosity, how performed the candidates on real tasks on the job then?
- fb03 3y ago
  I got that fizzbuzz reference. Stack Overflow thread right?

codetrotter 3y ago

How do you guys get it to run? I tried with ollama, installed from Homebrew, on my M1 Max with 64GB RAM. I downloaded the phind-codellama model using ollama pull phind-codellama But when I give it a prompt, for example ollama run phind-codellama "write a production grade implementation of Sieve of Eratosthenes in Rust" It prints the following error message Error: Post "http://localhost:11434/api/generate": EOF and exits. Even though it worked to run ollama with some other models. Is the version in homebrew not able to run phind-codellama?

jmorgan 3y ago
Yes you'll need the latest version (0.0.16) to run the 34B model. It should run great on that machine! The download (both as a Mac app and standalone binary) is available here: https://github.com/jmorganca/ollama/releases/tag/v0.0.16 https://github.com/jmorganca/ollama/releases/tag/v0.0.16. And I will work on getting that brew formula updated as well! Sorry to see you hit an error!
- JoelJacobson 3y ago
  Is there a limit on the number of lines/tokens it can take as input? Can it be increased? The limit seems to be somewhere above 30 lines. I'm on a MacBook Pro M1 Max 64GB. % ollama --version ollama version 0.0.16 % ollama run phind-codellama "$(cat prompt.txt)" ⠧ Error: Post "http://localhost:11434/api/generate": EOF % wc prompt.txt 335 1481 11457 prompt.txt
  - syntaxing 3y ago
    This feature was surprisingly hard to find, but you can wrap multi line in “””. So start off with “””, then type or new line (with enter) anything you want, then close with “”” and it’ll run the whole prompt. (“”” is 3 parenthesis quote, the formatting from HN is making it look funny)
    - jquery 3y ago

troupo 3y ago

> It really is good > write c code to reverse a linked list The number of times I had to do it in real production code amounts to zero. The number of times I had to piece code from poorly documented external services, conflicting product requirements, and running on complex and weird environments has been ... well ... multiple times a day for the past 20+ years. "instruct-like prompts" is what you give a very junior engineer out of college, and then you have to carefully review their code.