4 ms·
To run LLMs locally (Ollama/LLM Notebook), you want as much memory as you can afford. For actually training toy models yourself for learning/experiments in my e
by the_king 2y ago
To run LLMs locally (Ollama/LLM Notebook), you want as much memory as you can afford. For actually training toy models yourself for learning/experiments in my experience it doesn't matter much. PyTorch is flexible.