2 ms·
Meta Llama 3 Available on Cloudflare Workers AI
- dilipray 2y agoI faced latency challenges on llama2. So I haven’t used it. Usually OpenAI response is within 2 seconds, but llama2 takes 20+ seonds for the same. How are they tackling the performance?