2 ms·
Very cool! Depending on your local hardware, you could also run something like Z-Image Turbo or Klein locally, then use a daily CRON to pre-compute a bunch of n
by vunderba 8mo ago
Very cool! Depending on your local hardware, you could also run something like Z-Image Turbo or Klein locally, then use a daily CRON to pre-compute a bunch of new images for the game and serve them online as well~
That way you've got a fallback when credits run out, or if the 3rd party API takes too long to generate a new image, etc.
- tommywilczek 8mo agototally. to get it out the door I kept it in the cloud but that would be a good optimization. Honestly the biggest issue I've been facing is google's ability to host its 3 flash/3.1 flash-lite models. They CONSTANTLY return 503: model unavailable due to high usage... Next step will be to play with a more reliable LLM that's still fast and smart enough.