3 ms·
I don't think it's ChatGPT just based on the topic, but I wouldn't be surprised if it were just some big local model run manually (and probably stalled to run a
by drusepth 3y ago
I don't think it's ChatGPT just based on the topic, but I wouldn't be surprised if it were just some big local model run manually (and probably stalled to run all in the queue at once rather than having a beefy server running 24/7) and/or just more slowly run on a less-beefy machine and 24H is just padding to account for slower token/sec and not parallelizing generations across users.