Thank you for taking the time to read and write this up, something was "off" in the quotes describing the materials that had me at 4 of 5 alarm bells ringing. N

Thank you for taking the time to read and write this up, something was "off" in the quotes describing the materials that had me at 4 of 5 alarm bells ringing. Now I can super skim confidently and giggle. - real output here is text, using a finetuned Mixtral provided leading Qs - the initial "graph" with the silly beethoven-inspired material is probably hand constructed, they don't describe its creation process at all - later, they're constructing graphs with GPT-3.5 (!?) (they say rate limits, but somethings weird with the whole thing, they're talking about GPT-4 vision preview etc., which was roughly a year before the paper was released) - Whole thing reads like someone had a long leash to spend a year or two exploring basic consumer LLMs, finetune one LLM, and sorta just published whatever they got 6 months to a year later.