3 ms·
Still pretty unusable on Raspberry Pi 5, 16gb despite saying its built for it, from the E4B model total duration: 12m41.34930419s load duration:
by stevenhubertron 6mo ago
Still pretty unusable on Raspberry Pi 5, 16gb despite saying its built for it, from the E4B model
total duration: 12m41.34930419s
load duration: 549.504864ms
prompt eval count: 25 token(s)
prompt eval duration: 309.002014ms
prompt eval rate: 80.91 tokens/s
eval count: 2174 token(s)
eval duration: 12m36.577002621s
eval rate: 2.87 tokens/s
Prompt: whats a great chicken breast recipe for dinner tonight?
- stevenhubertron 6mo agoOn my MBP M4 Pro 48gb same model/question while multitasking with Figma, email etc: total duration: 37.44872875s load duration: 145.783625ms prompt eval count: 25 token(s) prompt eval duration: 215.114666ms prompt eval rate: 116.22 tokens/s eval count: 1989 token(s) eval duration: 36.614398076s eval rate: 54.32 tokens/s