4 ms·
In my experience running the same prompt always get's different results. Maybe they cache between different people but I'm not sure that'd be worth the cache sp
by thewataccount 4y ago
In my experience running the same prompt always get's different results. Maybe they cache between different people but I'm not sure that'd be worth the cache space at that point? although 8x A100s is a lot to not have caching...