4 ms·

I got it to build and run the example app on my M3 max with 36 gb ram. Memory pressure was around 32 gb

• dimask 3y ago
  Did you quantise it? At what level and what was your impression compared to other recent smaller models at that quantisation, if so?
  • kungfupawnda 3y ago
    No I just ran it out of the box but I had to modify the source code to run for Mac. Instructions here: https://github.com/facebookresearch/llama/pull/947/ https://github.com/facebookresearch/llama/pull/947/
    • deleted 3y ago
      [deleted]