Large scale document classification tasks in very ambiguous contexts. A lot of my work goes into using big models to generate training data for smaller models.

Large scale document classification tasks in very ambiguous contexts. A lot of my work goes into using big models to generate training data for smaller models. I have multiple millions of documents so GPT is cost prohibitive, and too slow. My tools of choice tend to be a first pass with Mistral to check task performance and if lacking using Mixtral. Often I find with a good prompt Mistral will work as well as Mixtral and is about 10x faster. I’m on my “home” network, but it’s a “home office” for my startup.