3 ms·
This library is so cool. It makes spinning up a quick demo incredibly easy - I've used it in Observable notebooks a few times: - CLIP in a browser: https://obs
by simonw 3y ago
This library is so cool. It makes spinning up a quick demo incredibly easy - I've used it in Observable notebooks a few times:
- CLIP in a browser: https://observablehq.com/@simonw/openai-clip-in-a-browser https://observablehq.com/@simonw/openai-clip-in-a-browser
- Image object detection with detra-resnet-50: https://observablehq.com/@simonw/detect-objects-in-images https://observablehq.com/@simonw/detect-objects-in-images
The size of the models feels limiting at first, but for quite a few applications telling a user with a good laptop and connection that they have to wait 30s for it to load isn't unthinkable.
The latest releases adds binary embedding quantization support which I'm really looking forward to trying out: https://github.com/xenova/transformers.js/releases/tag/2.17.0 https://github.com/xenova/transformers.js/releases/tag/2.17....
- sroussey 3y agoBinary embeddings will require additional re-rankings, but will be fun to test. I’ve made an npm package of transformers.js v3, which I should update (not sure if I include this yet). Mostly, I’ve had to have a fork so it runs on bun. V3 when released will support bun just fine. Although the webgpu won’t work, but that’s optional. [edit: dm if you want to use it, I don’t want to promote a fork]