4 ms·

I've been very happy with pydantic-ai, it blows the rest of the python ai ecosystem out of the water

• gHA5 1y ago
  Are you using Pydantic AI for structured output? If so, have you also tried instructor?
  • maxdo 1y ago
    I personally just switched to https://docs.boundaryml.com/guide/comparisons/baml-vs-pydantic https://docs.boundaryml.com/guide/comparisons/baml-vs-pydant... just feels a bit more polished. especially testing part.
    • Aherontas 1y ago
      Haven't tried balm, I will give it a shot, I am really curious to see all the features it supports.
  • mmargenot 1y ago
    `outlines` (https://github.com/dottxt-ai/outlines https://github.com/dottxt-ai/outlines) is very good and supported by vLLM as a backend structured output provider (https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.html https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.h...) for both local and remote LLMs. vLLM is probably the best open source tooling for the inference side right now.
  • colonCapitalDee 1y ago
    I did look at instructor and probably for structured output pydantic-ai and instructor are about the same, but pydantic-ai supports a ton of other stuff that isn't part of instructor's feature set. For me killer apps were the ability to serialize/deserialize conversations as json; frictionless tool-calling; and ability to mock the LLM client for testing.