3 ms·
I did not dislike your comment. The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a
by tarruda 4y ago
I did not dislike your comment.
The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a machine learning model on my computer.
I could not do it with the unmodified pytorch model (my GPU is not powerful enough to run even the 7B model), but I was surprised on how easy it was running with llama.cpp. I literally just followed the steps in the github page.
But I was biased in saying it was easy, since I do have other knowledge (such as C development on Linux) which helped me.