3 ms·
> using the last hidden layer iirc this is a well supported task iirc called "classification head" instead of "language modeling head" in case anyone else wan
by throwawaymaths 2y ago
> using the last hidden layer
iirc this is a well supported task iirc called "classification head" instead of "language modeling head" in case anyone else wants to do this as a fine-tuning project