3 ms·
> at the end of the day prompts are just a API call and it's easier to write standard code that treats LLM calls as a flaky API call They are also dull (highe
by devdiary 2y ago
> at the end of the day prompts are just a API call and it's easier to write standard code that treats LLM calls as a flaky API call
They are also dull (higher latency for same resources) APIs if you're self-hosting LLM. Special attention needed to plan the capacity.