4 ms·

I would love to have a dedicated server to run custom LLM models like llama, alpaca, but with dedicated context and memory (like knowning my codebase :). I'm n

I would love to have a dedicated server to run custom LLM models like llama, alpaca, but with dedicated context and memory (like knowning my codebase :). I'm not an ai expert yet but: 1. Is this processor suitable for that? 2. Is it feasible to customize one of the LLM models directly on that machine or retraining the model requires more power?

mkl 3y ago
For machine learning stuff like that you would be much better off with something that has a GPU.
adastra22 3y ago
No. You absolutely need a powerful, preferably NVIDIA GPU for that use case.
leobg 3y ago
For fine tuning I can recommend vast.ai. Easy and cheap.