2 ms·
But is it saying "'affor affor affor...(repeated 100+ times)" really fast? But actually, did you download the linked model from Kaggle ("gemma-2b-it-gpu-int4.b
by mjks 3y ago
But is it saying "'affor affor affor...(repeated 100+ times)" really fast?
But actually, did you download the linked model from Kaggle ("gemma-2b-it-gpu-int4.bin") and upload it into the demo? It is working fine for me out of the box.
- qrian 3y agoyes, I loaded the 1.35GB .bin file.
- hackerrrrx 3y agoAre u using 'gpu' one? what's your platform. my mbp2019 seems good