2 ms·
I think this is something that sample biasing would work better for, which you could do with local LLM's. For example with ad-llama[1] you would just have a sam
by gsuuon 3y ago
I think this is something that sample biasing would work better for, which you could do with local LLM's. For example with ad-llama[1] you would just have a sampler bias like so:
const knownColumns = ['name', 'email', 'id']
template`
SELECT "${a('column name', {
sampler: bias.accept(oneOf(knownColumns))
})}"
FROM "table"
`
You're able to enforce, at the sampler level, that the output is one of the expected choices.
[1] https://ad-llama.vercel.app/playground/ https://ad-llama.vercel.app/playground/