4 ms·
I've been meaning to write up a blog post. I've had a lot of success with: - Using LLMs to summarize, create structure, etc., rather than relying on them to ge
by npilk 3y ago
I've been meaning to write up a blog post. I've had a lot of success with:
- Using LLMs to summarize, create structure, etc., rather than relying on them to generate responses
- Having my apps rely on receiving LLM output in an exact format (e.g. an OpenAI function call) and raising an error otherwise
- Never showing generated outputs directly to a user or saving them directly to the database (avoids a lot of potential for unexpected behavior)
This kind of stuff is less flashy than chatbots for everything, but IMO has a lot more potential to actually impact how software works at scale in the next ~year or two.
- cschmatzler 3y agoTo add to the first point, creating documentation from bullet points. Prompting something like “Phrase the following points as technical documentation. Use the Microsoft Technical Writing Style Guide. Don’t add or remove any information” is really good.
- jkaptur 3y agoDo you publish the points themselves at the top? I'm mystified by the popular desire to have an LLM "expand" their writing. Can't you just publish what you wanted to say?
- duringwork12 3y agoI use a prompt that says I'm esl to make it sound more like natural english and i found i get less questions and better results on written persuasion at work since i started using it