3 ms·
I'll tell you this. Output isn't too cheap to meter, there is no decoder.
by adroitboss 2mo ago
I'll tell you this. Output isn't too cheap to meter, there is no decoder.
- krackers 2mo agoSo an encoder-only model with a classifier trained on the heads or something? DeepSeek recently switched to an encoder-decoder architecture in an attempt to get the best of both worlds (fast prefill while preserving generation capability), I wonder if that might be the future?
- adroitboss 2mo agoThis is basically what they have. https://github.com/fastino-ai/GLiNER2 https://github.com/fastino-ai/GLiNER2