2 ms·
Are you able to share how it works in that case?
by dennisy 20d ago
Are you able to share how it works in that case?
- adroitboss 20d agoI'll tell you this. Output isn't too cheap to meter, there is no decoder.
- krackers 20d agoSo an encoder-only model with a classifier trained on the heads or something? DeepSeek recently switched to an encoder-decoder architecture in an attempt to get the best of both worlds (fast prefill while preserving generation capability), I wonder if that might be the future?
- adroitboss 20d agoThis is basically what they have. https://github.com/fastino-ai/GLiNER2 https://github.com/fastino-ai/GLiNER2