3 ms·
It's an slm (small language model) due to number of parameters and it uses the same architecture as an llm, but llms have billions of parameters
by alightsoul 2mo ago
It's an slm (small language model) due to number of parameters and it uses the same architecture as an llm, but llms have billions of parameters
- dogma1138 2mo agoIs it? What is the cut off these days in terms of number of parameters? And where do other language models such as BERT/ROBERTA which are encoder only fit?