3 ms·
(Not the OP) >> (implicit: they won’t be for the prize set unless the OP submits with an open LLM implementation) > The solution is the Python program, not th
by nl 2y ago
(Not the OP)
>> (implicit: they won’t be for the prize set unless the OP submits with an open LLM implementation)
> The solution is the Python program, not the LLM prompts that iterated on a Python program. A common thread that would describe the confusing experience of reading your comment phrased aggressively and disputing everything up until you agree with me: your observations assume I assume the solution requires a cloud-based LLM to run. As noted above, it doesn't, which is also the thrust of my comment: they found a way to skirt what I thought the rules are, and the co-founder and Chollett have embraced it, publicly.
I think the implication is that solutions that use an LLM via an API won't be eligible (the "no internet" rule).
This seems obvious to solve: can use GPT4 to generate catalogs in advance and a lesser, local LLM with good code abilities to select them.
I don't see why this skirts any rules you think were implied and I'm puzzled why you think it does.
> sounds like both you and I agree that having an LLM generate Python programs isn't quite what we'd thought would be an AGI solution in the eyes of Chollet.
> Alas, here we are.
Chollet noted that program synthesis was a promising approach, so it's not surprising to me that a program synthesis approach that also uses an LLM is effective.