3 ms·Darling, we'll always have W_q, W_k, W_v, and W_o.by lucisferre 4mo agoDarling, we'll always have W_q, W_k, W_v, and W_o.