5 ms·
I'm not familiar with how TypeChat works, but Guidance [1] is another similar project that can actually integrate into the token sampling to enforce formats. [
by osaariki 3y ago
I'm not familiar with how TypeChat works, but Guidance [1] is another similar project that can actually integrate into the token sampling to enforce formats.
[1]: https://github.com/microsoft/guidance https://github.com/microsoft/guidance
- behnamoh 3y agoexcept that guidance is defunct and is not maintained anymore.
- huac 3y agodid they announce that anywhere? it does appear like progress has slowed down quite a lot.
- J_Shelby_J 3y agoIt’s logit bias. You don’t even need another library to do this. You can do it with three lines of python. Here’s an example of one of my implementations of logit bias. https://github.com/ShelbyJenkins/shelby-as-a-service/blob/7430788aebc817e477f369fcdb055ccb3e86ee0c/app/agents/async_shelby_agent.py#L114 https://github.com/ShelbyJenkins/shelby-as-a-service/blob/74...