3 ms·
Not just a projection layer but also Q-former, in this case it was already trained for that specific vision encoder but if you change it you would need to train
by GaggiX 3y ago
Not just a projection layer but also Q-former, in this case it was already trained for that specific vision encoder but if you change it you would need to train a Q-former from scratch.
- famouswaffles 3y agoNot for mini gpt-4 but it's just a projection layer for many others(like Llava). The Qformer isn't a necessary part of the equation.