4 ms·
Are you using Pydantic AI for structured output? If so, have you also tried instructor?
by gHA5 1y ago
Are you using Pydantic AI for structured output? If so, have you also tried instructor?
- maxdo 1y agoI personally just switched to https://docs.boundaryml.com/guide/comparisons/baml-vs-pydantic https://docs.boundaryml.com/guide/comparisons/baml-vs-pydant... just feels a bit more polished. especially testing part.
- Aherontas 1y agoHaven't tried balm, I will give it a shot, I am really curious to see all the features it supports.
- mmargenot 1y ago`outlines` (https://github.com/dottxt-ai/outlines https://github.com/dottxt-ai/outlines) is very good and supported by vLLM as a backend structured output provider (https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.html https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.h...) for both local and remote LLMs. vLLM is probably the best open source tooling for the inference side right now.
- colonCapitalDee 1y agoI did look at instructor and probably for structured output pydantic-ai and instructor are about the same, but pydantic-ai supports a ton of other stuff that isn't part of instructor's feature set. For me killer apps were the ability to serialize/deserialize conversations as json; frictionless tool-calling; and ability to mock the LLM client for testing.