3 ms·
Looks great, thanks for training this! - Can I fine tune it with SentenceTransformers? - I see ColBERT in the benchmarks, is there an answerai-colbert-smal
by jbellis 2y ago
Looks great, thanks for training this!
- Can I fine tune it with SentenceTransformers?
- I see ColBERT in the benchmarks, is there an answerai-colbert-small-v2 coming soon?
- gunalx 2y agoSeems like it. They even have example training scripts available. https://github.com/AnswerDotAI/ModernBERT/blob/main/examples/train_st.py https://github.com/AnswerDotAI/ModernBERT/blob/main/examples... Check out their documentation page linked on the bottom of the article. https://huggingface.co/docs/transformers/main/en/model_doc/modernbert https://huggingface.co/docs/transformers/main/en/model_doc/m...
- jph00 2y agoThe creator of answerai-colbert-small-v2 (bclavie) is also the person that launched the ModernBERT project, so yes, you can expect to see a lot of activity in this space! :D (Also yes, it works great with ST and we provide a full example script.)