4 ms·
It's not a 4B parameter model. The E4B variant is 7B parameters with 4B loaded into memory when using per-layer embedding cached to fast storage, and without vi
by Deathmax 1y ago
It's not a 4B parameter model. The E4B variant is 7B parameters with 4B loaded into memory when using per-layer embedding cached to fast storage, and without vision or audio support.
- zamadatix 1y agoThe link says E2B and E4B have 4B and 8B raw parameters, where do you see 7B?
- jdiff 1y agoThere's a 7B mentioned in the chat arena ELO graph, I don't see any other references to it though.
- osanseviero 1y agoHi! The model is 8B if you also load the vision and audio components. We just used the text model in LMArena.
- lostmsu 1y agoAre vision and audio components available yet?