6 ms·

Can someone explain how LangChain compares to Llama Index [1]? [1] https://github.com/jerryjliu/llama_index https://github.com/jerryjliu/llama_index

Jimmc414 3y ago
Langchain allows an LLM to initiate query and prompt workflows and observing the results in a sequential or conditional logic chain or workflow and invoking agents, while GPT Index (now Llama Index) excels at connecting an LLM to external data sources and implementing creative indexing schemes for querying within given token context windows. Right now they both fill a need and complement each other nicely.
- bugglebeetle 3y ago
  Do you have any good/interesting examples of these prompt workflows with langchain? I can see the utility in the abstract, but haven’t seen anything out in the world beyond clever toy projects.
  - TrevorJ 3y ago
    Entirely notional as of now, but I plan on testing it for game development. The thought is, you could create an embedding of the lore, data, facts and state of your game world and then interrogate the LLM about this in various ways. I see this being very useful both during the authoring of the game, and at runtime.
    - darkteflon 3y ago
      That’s awesome, wonderful idea. “State Machine games” is incredibly hard to Google!
      - TrevorJ 3y ago
        I'm realizing I probably should update my bio on here more than once every decade! Currently working full time in a related industry, so most of my AI experimentations are strictly on my own time these days. If anyone is interested in these same sorts of things I am on twitter @TrevorJ
  - Jimmc414 3y ago
    This is a good cookbook style collection of notebooks that illustrate the Langchain functionality https://github.com/gkamradt/langchain-tutorials https://github.com/gkamradt/langchain-tutorials Pinecone has some comparable langchain 'recipe' notebooks in their pinecone-io\examples Github repo
    - bugglebeetle 3y ago
      Thank you! I’ll check these out!
      - nell 3y ago
        Be careful out there when using Pinecone. The pricing seems to be confusing. https://twitter.com/Exploringfornow/status/1642607079285219328 https://twitter.com/Exploringfornow/status/16426070792852193...
        bugglebeetle 3y ago
        Yikes! Thanks for the heads up.

Jimmc414 3y ago

Langchain allows an LLM to initiate query and prompt workflows and observing the results in a sequential or conditional logic chain or workflow and invoking agents, while GPT Index (now Llama Index) excels at connecting an LLM to external data sources and implementing creative indexing schemes for querying within given token context windows. Right now they both fill a need and complement each other nicely.

bugglebeetle 3y ago
Do you have any good/interesting examples of these prompt workflows with langchain? I can see the utility in the abstract, but haven’t seen anything out in the world beyond clever toy projects.
- TrevorJ 3y ago
  Entirely notional as of now, but I plan on testing it for game development. The thought is, you could create an embedding of the lore, data, facts and state of your game world and then interrogate the LLM about this in various ways. I see this being very useful both during the authoring of the game, and at runtime.
  - darkteflon 3y ago
    That’s awesome, wonderful idea. “State Machine games” is incredibly hard to Google!
    - TrevorJ 3y ago
      I'm realizing I probably should update my bio on here more than once every decade! Currently working full time in a related industry, so most of my AI experimentations are strictly on my own time these days. If anyone is interested in these same sorts of things I am on twitter @TrevorJ
- Jimmc414 3y ago
  This is a good cookbook style collection of notebooks that illustrate the Langchain functionality https://github.com/gkamradt/langchain-tutorials https://github.com/gkamradt/langchain-tutorials Pinecone has some comparable langchain 'recipe' notebooks in their pinecone-io\examples Github repo
  - bugglebeetle 3y ago
    Thank you! I’ll check these out!
    - nell 3y ago
      Be careful out there when using Pinecone. The pricing seems to be confusing. https://twitter.com/Exploringfornow/status/1642607079285219328 https://twitter.com/Exploringfornow/status/16426070792852193...
      - bugglebeetle 3y ago
        Yikes! Thanks for the heads up.