4 ms·

3rd Place Solution for the Arc Prize 2024 Competition: Omni-Arc Approach

• zurfer 2y ago
  "Prompting is not enough, test-time fine-tuning is needed Clearly this competition has shown that LLMs need test-time fine-tuning to do new tasks. Few-shot prompting is not enough for the model to learn novel tasks." pretty interesting. However, only a pretty small model was used Qwen2.5-0.5B-Instruct. Bigger models were not available because of competition runtime constraints.