3 ms·

They say hill climbing https://microsoft.ai/news/building-a-hillclimbing-machine-launching-seven-new-mai-models/ https://microsoft.ai/news/building-a-hillclimb

by fooker 5mo ago

They say hill climbing https://microsoft.ai/news/building-a-hillclimbing-machine-launching-seven-new-mai-models/ https://microsoft.ai/news/building-a-hillclimbing-machine-la... Unless they specifically clarify that the testing and training benchmarks are completely separate, we have to assume they test on the same 'hill' the model climbs.

ajyoon 5mo ago
[flagged]
jongalloway2 5mo ago
[dead]
artemisart 5mo ago
Hill climbing doesn't mean much but absolutely doesn't imply they cheat on benchmarks. They have more details here https://microsoft.ai/news/introducing-mai-thinking-1/ https://microsoft.ai/news/introducing-mai-thinking-1/ it seems to be "RL on everything".
- deleted 5mo ago
  [deleted]