3 ms·
Since people are not reading the paper, here were the conclusions: > Is it really easy to answer semantic reasoning questions over symbolic graphics programs?
by abernard1 2y ago
Since people are not reading the paper, here were the conclusions:
> Is it really easy to answer semantic reasoning questions over symbolic graphics programs? We provide an intriguing experiment to demonstrate that SVG programs can be quite difficult for LLMs to understand such that even if the corresponding rendered images are fairly easy for humans to recognize, all these powerful LLMs still fail dramatically, only reaching a chance-level accuracy.
They then fine tune the model for this problem, and it achieves better results.