> What kind of prompts are you using? I hack on them till I get something sort of satisfying. > You'd be surprised how much better your output is using prompt

> What kind of prompts are you using? I hack on them till I get something sort of satisfying. > You'd be surprised how much better your output is using prompting techniques tailored for your goal. The biggest problem I encounter is context length, not necessarily the output for small inputs. It starts forgetting very fast, whether it's Claude, GPT+ or other self hosted models I've tried.