2 ms·
Didn't Microsoft use HumanEval as the basis for developing Phi? If so I'd say it works well enough! (At least Phi 3, haven't tested the others much.) Though th
by andai 3y ago
Didn't Microsoft use HumanEval as the basis for developing Phi? If so I'd say it works well enough! (At least Phi 3, haven't tested the others much.)
Though their training set is proprietary, it can be leaked by talking with Phi 1_5 about pretty much anything. It just randomly starts outputting the proprietary training data.
- kristianp 3y agoHumaneval was developed for codex I believe: https://arxiv.org/abs/2107.03374 https://arxiv.org/abs/2107.03374