3 ms·
Yes, I'm planning to use Gemini for this context because of the 1M context length, but 15 reqs per min seems to be a little off :( However, my implementation (
by lakssh 2y ago
Yes, I'm planning to use Gemini for this context because of the 1M context length, but 15 reqs per min seems to be a little off :(
However, my implementation (not entirely mine btw) will ensure that whatever the user gets as an output is a valid & type-safe JSON response; otherwise, it will throw an error.