7 ms·
Did you quantise it? At what level and what was your impression compared to other recent smaller models at that quantisation, if so?
by dimask 3y ago
Did you quantise it? At what level and what was your impression compared to other recent smaller models at that quantisation, if so?
- kungfupawnda 3y agoNo I just ran it out of the box but I had to modify the source code to run for Mac. Instructions here: https://github.com/facebookresearch/llama/pull/947/ https://github.com/facebookresearch/llama/pull/947/
- deleted 3y ago[deleted]