3 ms·
Chatbots use random number generators to create a variety of output, so it would be a terrible idea to use natural language as "source code" for a code generati
by skybrian 4y ago
Chatbots use random number generators to create a variety of output, so it would be a terrible idea to use natural language as "source code" for a code generation tool. Running a chatbot shouldn't happen within a build process, because the results aren't reproducible.
Once you have the source code though, you can use a variety of tools to manipulate it and save the result. Using chatbots to make modifications under supervision is fine. You discard bad modifications and save the good ones.
This is using natural language for one-offs and source code for reproducible results. It's looking like they will go well together.
- FractalHQ 4y agoCan you not provide a seed to an LLM the way you can with some of the image / video generation models I’ve seen?
- skybrian 4y agoYes, probably, if you got one that runs locally. OpenAI doesn’t have a way to do it in their API. There are other reasons not to do it, like it being an external API that charges money. And even if you got something local and deterministic, the generated code would be less easily tweaked by editing the original prompt than by asking the LLM to make the change you want, or by editing the code directly.