2 ms·
Does anybody find it mildly ironic that LLM prompts, which are intended to be plain informal text, accumulate more and more structure around them, including a m
by nine_k 1y ago
Does anybody find it mildly ironic that LLM prompts, which are intended to be plain informal text, accumulate more and more structure around them, including a markup language in question?
This is not unlike the way the language of legal documents is highly formulaic, structured, and codified. When precise meaning is desirable, firmer structures tend to arise. With a bit more time, proper code languages may start to appear, to help tell LLMs exactly what we mean or want.
- dragonwriter 1y agoThis markup language isn't structure for prompts for LLMs, it is structure for conventional programs that need to construct prompts for LLMs. Conventional programs using structured templates with deterministic rules to construct output is... not new. (Jinja templates have been widely used for communicating structure to assemble conversation history, tool calls, etc., into promots for open models for a while.)
- creatonez 1y agoIt is both. The structure does actually help LLMs. Interestingly, LLMs seem to respond well to the repetition of XML-like structure (that is, the presence of closing tags), even if it's just an ad-hoc constructed language with no real schema.
- Terretta 1y agoNot sure if changed with GPT-5, but Claude was explicitly tuned to leverage XML-like tags, while GPT-3.5 and 4 seemed to prefer Markdown-like structure. https://docs.anthropic.com/en/docs/build-with-claude/prompt-engineering/use-xml-tags https://docs.anthropic.com/en/docs/build-with-claude/prompt-...
- beefnugs 1y agoThis is "The Dream" vs whatever actually happened