4 ms·
are there lessons here for regular (non vision) transformers? sounds close to attention sinks/pause tokens?
by swyx 2y ago
are there lessons here for regular (non vision) transformers? sounds close to attention sinks/pause tokens?
loading thread…