4 ms·

I'm no python expert but it looks like this does happen in memory: https://github.com/ianb/infinite-ai-array/blob/main/iaia/magicmodule.py#L23 https://github.co

I'm no python expert but it looks like this does happen in memory: https://github.com/ianb/infinite-ai-array/blob/main/iaia/magicmodule.py#L23 https://github.com/ianb/infinite-ai-array/blob/main/iaia/mag... I can't imagine it's too hard to serialize the `existing` python dict so subsequent runs are deterministic

wging 4y ago
It is also caching requests on-disk. See for instance https://github.com/ianb/infinite-ai-array/blob/main/iaia/gptclient.py#L76-L87 https://github.com/ianb/infinite-ai-array/blob/main/iaia/gpt... The problem* is that if a prompt changes slightly then it won't be a cache hit. * okay, one problem.