I assume Kimi does provide logits. You can do cross entropy both ways. With slightly different results. Edit: No that doesn't seem to be what's happening here.

I assume Kimi does provide logits. You can do cross entropy both ways. With slightly different results. Edit: No that doesn't seem to be what's happening here. I think it's some kind of word frequency analysis.