3 ms·
I'll tell you this. Output isn't too cheap to meter, there is no decoder.
by adroitboss 19d ago
I'll tell you this. Output isn't too cheap to meter, there is no decoder.
- krackers 19d agoSo an encoder-only model with a classifier trained on the heads or something? DeepSeek recently switched to an encoder-decoder architecture in an attempt to get the best of both worlds (fast prefill while preserving generation capability), I wonder if that might be the future?
- adroitboss 18d agoThis is basically what they have. https://github.com/fastino-ai/GLiNER2 https://github.com/fastino-ai/GLiNER2