4 ms·
Ask HN: Best Embedding Models?
Hey HN, which embedding models are people using? There has been so much development around foundational LLMs, but haven't seen much news about embedding models.
- rapatel0 6mo agoI've liked qwen and embeddinggemma for local search. Qwen because 32K is enough to basically fit a whole page into the context window and embeddiggemma because it's crazy efficient.
- jayshah5696 6mo agoembeddings are easy to fine tune. Try modern bert.
- PhilippGille 6mo agoBenchmarks only paint part of the picture, but it's still a decent place to start looking into recent models: https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard
- didgeoridoo 6mo agoI’m partial to jina.ai — they have open models for code and prose, all easily runnable locally.
- frederickabrah 6mo agowho knows a tool for rug check in crypto
- LogicCraft678 6mo agoFeels like embeddings are underrated compared to LLM's hype, but they doing great.
- Alifatisk 6mo agoWhy do you feel like embeddings are underrated? What is it with embeddings that deserves more attention?
- halvorbuilds 6mo agogemma4
- emschwartz 6mo agoI’ve been using MixedBread, which is a pretty old model at this point. Recently, I tried comparing it to some newer models and was disappointed that the results weren’t dramatically and uniformly better. You probably can’t go wrong if you pick a recent one that scores decently well on benchmarks and is at the right price point (or memory requirement) for whatever you’re trying to do.
- Yogeshshirsath 6mo agoE5 (Microsoft)
- IVski 6mo ago[flagged]
- pstorm 6mo agoJust fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
- preetsojitra 6mo agoMeta's Perception Encoder Audio-Visual, its CLIP like but has three modality: Audio, Video and Text
- stevenfazzio 6mo agoCohere's embed-v4.0 is my daily driver as far as a high performance model is concerned. I do a lot of cluster analysis and data visualization and I like that there's an `input_type="clustering"` mode in addition to the standard `input_type="search"` mode. For a fast, open, and local model, I've found it hard to beat https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2 https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...
- _tgxm 6mo agoI am using openai small embedding model with custom compression. It is super cheap. You can read more at https://corvi.careers/blog/vector-search-embedding-compression/ https://corvi.careers/blog/vector-search-embedding-compressi...
- sovenyr 6mo agoplease check OpenAI embedding models - especially small one
- mutant 6mo agonot a single "of what data" or "in what env" best in what?