3 ms·

So an encoder-only model with a classifier trained on the heads or something? DeepSeek recently switched to an encoder-decoder architecture in an attempt to get

So an encoder-only model with a classifier trained on the heads or something? DeepSeek recently switched to an encoder-decoder architecture in an attempt to get the best of both worlds (fast prefill while preserving generation capability), I wonder if that might be the future?

adroitboss 10d ago
This is basically what they have. https://github.com/fastino-ai/GLiNER2 https://github.com/fastino-ai/GLiNER2