4 ms·The embedding size is only 8k so while the parameters are 70B. So it's a huge differenceby tama_sala 2y agoThe embedding size is only 8k so while the parameters are 70B. So it's a huge difference