3 ms·

Definitely, I'd be interested even if you could just outline them!

• petesergeant 1y ago
  Here is one I wrote today on LLMs that can handle chat input like humans write: multiple disjointed messages arriving asynchronously that need to be treated as one: https://sgnt.ai/p/interruptible-llm-responses/ https://sgnt.ai/p/interruptible-llm-responses/ I use a similar technique to the article for trying to avoid jailbreaks by putting untrusted input through zod to check I got back a JSON structure of the right shape, which has been very effective. I’ve been sprinkling lexical in-memory search throughout prompts to save inference calls, which has been very effective