3 ms·
Is LLM even applicable to many things though? If we want more nuanced and contextual vision, does LLM help?
by steve_adams_86 4y ago
Is LLM even applicable to many things though? If we want more nuanced and contextual vision, does LLM help?
- jerpint 4y agoFine tuning models is where the future will be, it doesn’t necessarily mean LLMs but I suspect that LLMs will shortly become multi modal and at that point they will be the ultimate models to fine tune for a given task
- saliagato 4y agoThanks for the comment. >Fine tuning models is where the future will be Who would request fine tuning? Businesses? Are you suggesting to build some sort of data set broker?
- jstx1 4y agoBusinesses who have their own data fine tune trained models (this is already a thing). So you need model repositories (like hugging face) not dataset brokers.
- tux3 4y agoMultimodal models are also a red hot area. The interesting thing might be to combine specialized instances of LLMs and other models together, where each runs a specific subtask or event processing loop. I think it'd be fun to use vision models to pick up the interesting parts of an image, describe only the high-yield context as English text, and put them in a sort of Unix pipeline or node graph to connect it to other models that can input/output text. With fine-tuned or prompt-engineered LLMs as the intelligent centerpiece.
- PartiallyTyped 4y agoThe LLM component is almost correct, but not exactly. The whole point is the transformer architecture, which really is just graph neural networks. Once you start seeing things through these lenses, the possibilities are endless and it starts making sense.