2 ms·
I think in domains like Math and Software Engineering, they are less constrained by training data anyway. They can synthetically generate and validate programs.
by Sol- 6mo ago
I think in domains like Math and Software Engineering, they are less constrained by training data anyway. They can synthetically generate and validate programs. To what extent that scales into novel insights is a different matter, but I think they dream of the AlphaGo Zero moment at least in verifiable domains.
- davebren 6mo agoHow can it ever play against itself on novel software tasks? First it has to come up with the task. Then it can write tests but then it needs to verify that the tests are correct, mixture of experts can come to wrong conclusions, etc...