7 ms·
Apart from maximizing compatibility, is there a technical reason why GPU is not used if available?
by febed 3mo ago
Apart from maximizing compatibility, is there a technical reason why GPU is not used if available?
- soycaporal 3mo agomainly this is a portability and compatibility solution.. I think with GPU available deployments, it wouldn't benefit from ternary distillation. It would be a different problem domain.