3 ms·
It only says 'affor affor affor...(repeated 100+ times)' for me. I am not sure how to debug this.
by qrian 3y ago
It only says 'affor affor affor...(repeated 100+ times)' for me.
I am not sure how to debug this.
- mjks 3y agoBut is it saying "'affor affor affor...(repeated 100+ times)" really fast? But actually, did you download the linked model from Kaggle ("gemma-2b-it-gpu-int4.bin") and upload it into the demo? It is working fine for me out of the box.
- qrian 3y agoyes, I loaded the 1.35GB .bin file.
- hackerrrrx 3y agoAre u using 'gpu' one? what's your platform. my mbp2019 seems good
- magemgem 3y agoTry a different prompt
- qrian 3y agonope, all my prompts lead the the same answer.
- miohtama 3y agoIt thinks it’s a pokemon.
- impjdi 3y agothis can happen if you try to feed a cpu model to gpu inference. make sure you download the gpu model if you are using gpu accelerated ml inference.