3 ms·
Can the 30 second embedding time be done beforehand and sent to the browser? Inference is nice and quick after that.
by aetherspawn 3mo ago
Can the 30 second embedding time be done beforehand and sent to the browser?
Inference is nice and quick after that.
- soycaporal 3mo agoyes, you could run a 1 time indexing run on the server side, and just ship the embeddings to frontend