3 ms·
I would love to hear about the use cases where these small midrange models are most relevant. Does anyone have stories of those?
by Hugsun 3y ago
I would love to hear about the use cases where these small midrange models are most relevant.
Does anyone have stories of those?
- clwg 3y agoI use them for classification, entity extraction and embeddings. I also use them as a really light UI for tasks where I don't need the capabilities of GPT3.5/4 which is overkill for the more traditional NLP tasks.
- Hugsun 3y agoInteresting. Could you share some detailed examples? What sort of classification? What are examples of traditional NLP tasks?
- clwg 3y agoI would say anything from text classification, entity extraction, sentiment analysis, transcription, etc would be traditional NLP task, even things such as NYSIIS/Soundex processing can be handled by LLM's fairly effectively. Huggingface categorizes their various models by task https://huggingface.co/models https://huggingface.co/models so it is fairly straight forward to determine what models may fit your use case.
- qup 3y agoWhen I want to run it locally on normal hardware.
- hskalin 3y agoI have also been trying to find good use cases. Currently I use Mistral 7B for summarization (when I want a tldr) and its good enough. Due to this I am thinking about setting up a RAG system based on my local notes using it. Although I could just use chatGPT for summarization (sometimes I do), but having a local LLM feels nice. They are uncensored so they can be used for some fun ropleplays as well.
- deleted 3y ago[deleted]