3 ms·
Neat! When you say that "CPU is very slow", do you mean that using the CPU is (and always will be) slower than using the GPU, or that you could still optimize i
by sbt567 2y ago
Neat! When you say that "CPU is very slow", do you mean that using the CPU is (and always will be) slower than using the GPU, or that you could still optimize it further?
- J_Shelby_J 2y agoThe current implementation is very slow with a CPU. Probably, it could be optimized with parallelism for batches. I'm not sure how it could be improved for single embeddings.