4 ms·
Very cool and also very simple as I’d expect from Cloudflare. But I have a question - why not make inference as easy as the translation? Why do I have to run t
by jonplackett 3y ago
Very cool and also very simple as I’d expect from Cloudflare.
But I have a question - why not make inference as easy as the translation? Why do I have to run that in a worker rather than just as a simple API call? That would be much simpler.
Is there a technical reason or is it that people would want to have logic before making the call to llama?
- rita3ko 3y agoyou can do both! all of our models are supported either via workers / pages binding (which makes it really easy to host the rest of the logic), and via REST API docs: https://developers.cloudflare.com/workers-ai/get-started/rest-api/ https://developers.cloudflare.com/workers-ai/get-started/res... (llama specific example here too under curl: https://developers.cloudflare.com/workers-ai/models/llm/ https://developers.cloudflare.com/workers-ai/models/llm/ )
- jonplackett 3y agoAwesome! Thanks for that. Cloudflare smashing it on simplicity as per usual.