3 ms·
Ask the model nicely, check any json in the output against your schema, regenerate if it doesn’t match. Crude, I know, but it’s compatible with every model. Wh
by michaelt 3y ago
Ask the model nicely, check any json in the output against your schema, regenerate if it doesn’t match.
Crude, I know, but it’s compatible with every model. Which is useful if you want to compare the many different models out there.
- mark_l_watson 3y agoThat is a fairly good strategy. Six years ago at Capital One, I experimented with generating synthetic JSON AWS CloudWatch files for testing (that would not contain any sensitive information). Way back then I used LSTM models and I simply had code to check output and only keep valid samples. LLMs are so much better for this than LSTMs now.