4 ms·
> Actually I have been wondering why we need so many general-purpose models? People in this world come from different industries and what they need is targeted
by kouteiheika 3y ago
> Actually I have been wondering why we need so many general-purpose models? People in this world come from different industries and what they need is targeted solutions. Vertical models can address nuanced problems that general-purpose models might overlook due to their broad training.
It'd be interesting to see a direct comparison which would answer the question of "how many less parameters do you need for a targeted vertical model to solve the same problem as a general purpose model".
Like, for example, let's say we pick the task of translating Python to JavaScript, or just any other concrete task: how small could you make a model that only can do this task, vs a general purpose model that can also do this equally well plus a bunch of other things? I wonder if there are any interesting papers tackling this?