3 ms·
I have trouble getting simple extraction to work sometimes. I have a block of text describing people and their roles at a company and their ages, and i asked fo
by sroussey 2mo ago
I have trouble getting simple extraction to work sometimes. I have a block of text describing people and their roles at a company and their ages, and i asked for structured results of an array of these things with the text span that it appears in and all i can say is: nope.
- quotescoreai 2mo ago[flagged]
- jermaustin1 2mo agoI've done pretty decent local prose->json extraction using Qwen and Phi and Gemma. I'm sure most of it comes down to prompts, and all of them run over 100tps on a 3090. Smaller cards will likely be slower, but Qwen3.5 9B is small enough to fit on most consumer cards.