4 ms·
Type-conversions with FFI turned out to be non-trivial, so `{"embedding":[...]}` was a way out at the cost of a small performance hit (when compared to the time
by vishnumohandas 3y ago
Type-conversions with FFI turned out to be non-trivial, so `{"embedding":[...]}` was a way out at the cost of a small performance hit (when compared to the time spent on inference).
We'll take another look.
- lovasoa 3y agoThe result of clip.[...].call(...) is already a buffer, isn't it? You just have not to touch it at all. And on the cpp side, remove the json encoding and just return a raw buffer.