3 ms·

What's the implication of this new change for Microsoft Guidance, LMQL, Langchain, etc.? It looks like much of their functionality (controlling model output) ju

What's the implication of this new change for Microsoft Guidance, LMQL, Langchain, etc.? It looks like much of their functionality (controlling model output) just became obsolete. Am I missing something?

deleted 3y ago
[deleted]
lbeurerkellner 3y ago
If anything this removes a major roadblock for libraries/languages that want to employ LLM calls as a primitive, no? Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API. Either way, as part of the LMQL team, I am actually pretty excited about this, also with respect to what we want to build going forward. This makes language model programming much easier.
- koboll 3y ago
  `Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API.` Eh, would be pretty easy to write a wrapper that takes a functions-like JSON Schema object and interpolates it into a traditional "You MUST return ONLY JSON in the following format:" prompt snippet.
- londons_explore 3y ago
  > Although, I fear the vendor lock-in intensifies here, The openAI API is super simple - any other vendor is free to copy it, and I'm sure many will.
neuronexmachina 3y ago
Langchain added support for `function_call` args yesterday: * https://github.com/hwchase17/langchain/pull/6099/files https://github.com/hwchase17/langchain/pull/6099/files * https://github.com/hwchase17/langchain/issues/6104 https://github.com/hwchase17/langchain/issues/6104 IMHO, this should make Langchain much easier and less chaotic to use.
- gawi 3y ago
  It's only been added to the OpenAI interface. Function calling is really useful when used with agents. To include that to agents would require some redesign as the tool instructions should be removed from the prompt templates in favor of function definitions in the API request. The response parsing code would also be affected. I just hope they won't come up with yet another agent type.
  - neuronexmachina 3y ago
    Like this? https://github.com/hwchase17/langchain/blob/master/langchain/agents/openai_functions_agent/base.py https://github.com/hwchase17/langchain/blob/master/langchain...
    - gawi 3y ago
      LangChain is a perpetual hackathon.

deleted 3y ago

[deleted]

lbeurerkellner 3y ago

If anything this removes a major roadblock for libraries/languages that want to employ LLM calls as a primitive, no? Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API. Either way, as part of the LMQL team, I am actually pretty excited about this, also with respect to what we want to build going forward. This makes language model programming much easier.

koboll 3y ago
`Although, I fear the vendor lock-in intensifies here, also given how restrictive and specific the Chat API.` Eh, would be pretty easy to write a wrapper that takes a functions-like JSON Schema object and interpolates it into a traditional "You MUST return ONLY JSON in the following format:" prompt snippet.
londons_explore 3y ago
> Although, I fear the vendor lock-in intensifies here, The openAI API is super simple - any other vendor is free to copy it, and I'm sure many will.

neuronexmachina 3y ago

Langchain added support for `function_call` args yesterday: * https://github.com/hwchase17/langchain/pull/6099/files https://github.com/hwchase17/langchain/pull/6099/files * https://github.com/hwchase17/langchain/issues/6104 https://github.com/hwchase17/langchain/issues/6104 IMHO, this should make Langchain much easier and less chaotic to use.

gawi 3y ago
It's only been added to the OpenAI interface. Function calling is really useful when used with agents. To include that to agents would require some redesign as the tool instructions should be removed from the prompt templates in favor of function definitions in the API request. The response parsing code would also be affected. I just hope they won't come up with yet another agent type.
- neuronexmachina 3y ago
  Like this? https://github.com/hwchase17/langchain/blob/master/langchain/agents/openai_functions_agent/base.py https://github.com/hwchase17/langchain/blob/master/langchain...
  - gawi 3y ago
    LangChain is a perpetual hackathon.