4 ms·
> I really don't see the point, cross-platform software with multiple binaries is absolutely fine. I've shipped cross-platform software and it's a one time triv
by csdvrx 3y ago
> I really don't see the point, cross-platform software with multiple binaries is absolutely fine. I've shipped cross-platform software and it's a one time trivial cost to prepare a multi OS pipeline.
That's like people who said "I could do this dropbox thing in a weekend with just rsync, ssh and ftp"
You think you can, but even if you might cover this "one time trivial cost" once, 1) it doesn't scale well so you'll end up not doing it that often 2) most other people can't.
> people with GPUs likely want to use something with better performance
End users like performance, but first they need to be able to use something at all.
If you start with "compile this binary then download this 4Gb file then run that command in this terminal" you've lost 99% of the potential audience
I think you are missing the forest for the tree if you only see a technological hack instead of the change of paradigm it allows.
- bordercases 3y ago> That's like people who said "I could do this dropbox thing in a weekend with just rsync, ssh and ftp" And so begins the cycle of enshitification!
- pseudosavant 3y agoI'm getting >50 tokens/second with an RTX 2070 Super 8GB on Mistral 7B with llamafile. More than adequate performance.
- pseudosavant 3y agoFor context, I'm running this on my basic mainstream laptop (6-core, IGP, Ryzen 5 5500U) with 16GB RAM. I'm getting ~6 tokens/second for mistral-7b-v0.1.Q4_K_M.