3 ms·
The model discussed in the article is MiniLM-L6-v2, which you can run via PyTorch from the sentence-transformers project[1]. That model is based on BERT and no
by aduffy 3y ago
The model discussed in the article is MiniLM-L6-v2, which you can run via PyTorch from the sentence-transformers project[1].
That model is based on BERT and not LLaMa [2].
[1]: https://www.sbert.net/docs/pretrained_models.html https://www.sbert.net/docs/pretrained_models.html
[2]: https://huggingface.co/microsoft/MiniLM-L12-H384-uncased https://huggingface.co/microsoft/MiniLM-L12-H384-uncased