4 ms·
> Unfortunately, I have only seen 3 models, 3B or over, handle RAG. What's the unit "B" in "3B"? I can search for acronyms like "RAG" just fine, but you exper
by raegis 2y ago
> Unfortunately, I have only seen 3 models, 3B or over, handle RAG.
What's the unit "B" in "3B"? I can search for acronyms like "RAG" just fine, but you experts aren't making it easy for us beginners :)
Edit: Apologies, this is obvious. My brain needed a reboot for the new year.
- cauliflower2718 2y agoYou can ask an LLM exactly this question and it will tell you. (The answer is billions of parameters)
- SketchySeaBeast 2y agoBut what if they want to know they are finding the correct answer?
- elliotto 2y agoAsking anonymous people on a forum would be much better.
- SketchySeaBeast 2y agoAt least a forum with domain-specific knowledge.
- gpm 2y agoAnd people to go "no, that's wrong" if someone posts something that's wrong.
- greesil 2y agoNo, any answer will do.
- cauliflower2718 2y agoI think basic definitions for LLMs are solidly within the bounds of what we would expect e.g. chatgpt to be competent at. The task (defining terms) is simple and the specific content (basic LLM stuff) is easy to check by anyone who works on the LLM. I agree with the general sentiment that we should not just blindly trust LLMs though.
- jasonjmcghee 2y agotbf, the gp comment said 125MB and then 3B, which would be pretty confusing, as it's a typo and should be 125M.
- jwineinger 2y agoThe number of parameters the model is trained on, in billions
- jmward01 2y ago(B)illion. It indicates the rough number of parameters in the model. Higher is generally more capable. 1B models are currently at the top end of 'easy' to deal with for playing around fine tuning and the like for most home lab setups.