2 ms·
Cheating (using a internal chess engine) would be the obvious reason to me.
by lukan 2y ago
Cheating (using a internal chess engine) would be the obvious reason to me.
- TZubiri 2y agoNope. Calls by api don't use functions calls.
- permo-w 2y agothat you know of
- TZubiri 2y agoSure. It's not hard to verify, in the user ui, function calls are very transparent. And in the api, all of the common features like maths and search are just not there. You can implement them yourself. You can compare with self hosted models like llama and the performance is quite similar. You can also jailbreak and get shell into the container to get some further proof
- permo-w 2y agothis is all just guesswork. it's a black box. you have no idea what post-processing they're doing on their end
- girvo 2y agoHow can you prove this when talking about someones internal closed API?
- nske 2y agoBut in that case there shouldn't be any invalid moves, ever. Another tester found gpt-3.5-turbo-instruct to be suggesting at least one illegal move in 16% of the games (source: https://blog.mathieuacher.com/GPTsChessEloRatingLegalMoves/ https://blog.mathieuacher.com/GPTsChessEloRatingLegalMoves/ )