3 ms·
Good point. Maybe there'll be companies that maintain your on-premise GPU cluster just like there are companies that service the coffee machine in your office?
by codethief 4mo ago
Good point. Maybe there'll be companies that maintain your on-premise GPU cluster just like there are companies that service the coffee machine in your office?
- otabdeveloper4 4mo ago> on-premise GPU cluster Renting a GPU server from a cloud and hosting your own llama.cpp is the path of least resistance.
- mohamedkoubaa 4mo agoThis is far more likely than everyone racking their own servers.