3 ms·
This could become something useful in the future, but right now it appears to be toy models only. I'm assuming Cloudflare will add useful models eventually, but
by baobabKoodaa 3y ago
This could become something useful in the future, but right now it appears to be toy models only. I'm assuming Cloudflare will add useful models eventually, but the cold start times are going to be horrible on those. I'm struggling to think of useful applications for this. Maybe one day.
- celso 3y agoWhich models would you find useful?
- baobabKoodaa 3y agoDepends on the task, but generally, LLaMA 2 finetunes of at least 13B params, 4-bit quantized
- celso 3y agodid you see we have lamma2-7b int8?
- baobabKoodaa 3y agoCan you provide an example of a task where the 7b model is useful?