3 ms·They both seem to behave differently depending on how loaded the system seems to be.by j45 1y agoThey both seem to behave differently depending on how loaded the system seems to be.api 1y agoI have suspected for a long time that hosted models load shed by diverting some requests to lesser models or running more quantized versions under high load.deleted 1y ago[deleted]parineum 1y agoI think OpenRouter saves tokens by summarizing queries through another model, IIRC.