3 ms·
TGI+grammar loaded with Mistral/Mixtral works great for structured output now! No more langchain exception handling for unmatched Pydantic definitions.
by iAkashPaul 3y ago
TGI+grammar loaded with Mistral/Mixtral works great for structured output now! No more langchain exception handling for unmatched Pydantic definitions.