3 ms·
This is a basic question but maybe you can help: what is a good resource to use to understand how to take advantage of logits?
by 7thpower 1y ago
This is a basic question but maybe you can help: what is a good resource to use to understand how to take advantage of logits?
- ivape 1y agohttps://dottxt-ai.github.io/outlines/latest/ https://dottxt-ai.github.io/outlines/latest/ For OpenAI, you can just pass in the json_schema to activate it, no library needed. For direct LLM interfacing you will need to host your own LLM or use a cloud provider that allows you too hook in, but someone else may need to correct me on this. If anyone is using anything other than Outlines, please let us know.
- 7thpower 1y agoThank you!