3 ms·
Is there a set of program synthesis problems (or a source of problems) accepted by academics as a reasonable benchmark for measuring progress these days? Or doe
by LondonGeorge 5y ago
Is there a set of program synthesis problems (or a source of problems) accepted by academics as a reasonable benchmark for measuring progress these days? Or does each new approach find its own example problems to demonstrate their particular differences on?
- daralthus 5y agoPerhaps https://ml4code.github.io/tags.html#benchmark https://ml4code.github.io/tags.html#benchmark
- mechtaev 5y agoSyGuS competition (SyGuS-Comp)[1] is a widely-used collection of such problems, but of course there will always be problem domains that are not well-represented by standard benchmarks. 1. https://sygus.org/ https://sygus.org/