5 ms·

I just ran this on my new Mac Mini (installing the llama2 model) and got a full-blown kernel panic. What?!

• asabla 3y ago
  This may happen if you chose a model which is larger then your available unified memory. Which version of llama2 did you choose? And how much unified memory do you have?
  • xanderlewis 3y ago
    Just the default (7B parameters?), which apparently requires at least 8GB of RAM, which is how much I have. It seems to be running fine now... it's just the installation process that caused it to completely die.
    • coconut08 3y ago
      if it requires 8gb of ram and you have 8gb of ram that leaves nothing left for the other processes that need to run and the gpu which also shares the ram.
      • xanderlewis 3y ago
        I’m just surprised that the process can successfully eat all of the memory so badly that the OS actually dies. I thought there was protection for stuff like that.
        • karolist 3y ago
          There's not, mlock() will crash your machine from userland happily