5 ms·
I don't have a PC with a powerful GPU. What's the easiest way I can play with Llama on AWS, Google Cloud, or somebody else's computer?
by mFixman 3y ago
I don't have a PC with a powerful GPU. What's the easiest way I can play with Llama on AWS, Google Cloud, or somebody else's computer?
- Tepix 3y agoYou can play with Llama on your CPU. Depending on the model you use and the RAM you have available, the performance may be acceptable.
- anentropic 3y agousing llama.cpp it runs on the CPU this news story is that they are now extending GPU support to llama.cpp
- hospitalJail 3y agoDo you know about Oobabooga? You can probably find a google colab link.
- mFixman 3y agoIs that like a LLM Stable Diffusion? Neat.