3 ms·
Improving LLM chatbot UX by utilizing a stateful Markdown stream processor
- russellbeattie 3y agoOr you can specify that LLMs respond in valid HTML and save yourself the processing step.
- atesgoral 3y agoIgnoring the additional token count cost of HTML, how do you envision rendering HTML that is spit out by an LLM directly (without any processing) to the user?