2 ms·
Jeremy, this is awesome! Personally excited for a new wave of sentence transformers built off ModernBERT. A poster below provided the link to a sample ST traini
by ZQ-Dev8 2y ago
Jeremy, this is awesome! Personally excited for a new wave of sentence transformers built off ModernBERT. A poster below provided the link to a sample ST training script in the ModernBERT repo, so that's great.
Do you expect the ModernBERT STs to carry the same advantages over ModernBERT that BERT STs had over the original BERT? Or would you expect caveats based on ModernBERT's updated architecture and capabilities?
- jph00 2y agoYes absolutely the same advantages -- in fact the maintainer of ST is on the paper team, and it's been a key goal from day one to make this work well.
- data_ders 2y agowhat’s ST stand for here? I googled and only got results for BERT STS (semantic text similarity)
- bclavie 2y agoSentence Transformers (https://sbert.net/ https://sbert.net/), the most used library for embedding models (similarity, retrieval.)