3 ms·
I use my models primarily for code generation and evaluation. Does the latter part fall into “reasoning” territory?
by SOLAR_FIELDS 3y ago
I use my models primarily for code generation and evaluation. Does the latter part fall into “reasoning” territory?
- Palmik 3y agoAdvanced code generation, the kind you would need for something like AutoGPT or other agent-like system, is definitely reasoning and GPT-4 or Claude 2 will dominate. But most of the code generation from GitHub Copilot or other systems (like Replit) is much simpler pattern matching (and indeed, Replit afaik uses very small models). What do you mean by evaluation?
- SOLAR_FIELDS 3y agoMy personal use case is most often supplying files and generating unit tests, as well as supplying a section of code with a prompt about that section to evaluate the approach contextually with some other unseen code. Which perhaps is another form of reasoning.