4 ms·
I agree with much of the article. You do need to take great care to make code with embedded LLM use modular and easily maintainable, and otherwise keep code bas
by mark_l_watson 3y ago
I agree with much of the article. You do need to take great care to make code with embedded LLM use modular and easily maintainable, and otherwise keep code bases tidy.
I am a fan of tools like LangChain that bring some software order to using LLMs.
BTW, this article is a blog hosted by the company who writes and maintains the excellent spaCy library.
- passion__desire 3y agoIs anyone working on a OS LLM layer? e.g. consider a program like gimp. It would feed in its documentation and workflow details in LLM and get embeddings which would be installed with the program just like man-pages. Users could just express what they want to do in natural languages and Gimp would just query llm and create a workflow that might achieve the task.
- mark_l_watson 3y agoApple's CoreML is a large collection of regular models, deep learning models, etc. that are easy to use in macOS/iOS/iPadOS apps.
- __loam 3y ago> You do need to take great care to make code with embedded LLM use modular and easily maintainable, and otherwise keep code bases tidy. Sure makes sense. > I am a fan of tools like LangChain that bring some software order to using LLMs. Lmao. I feel like tools like LangChain that are really just very thin wrappers for the LLM APIs are quite complex for what they supposedly do for you. Lots of leaky abstractions and indirection for very little gained over just calling the APIs themselves.