2 ms·
It’s an encoder-decoder transformer trained on audio (language?) and transcription. Seems kinda weird for it not to meet the definition in a tautological way e
by big_toast 11mo ago
It’s an encoder-decoder transformer trained on audio (language?) and transcription.
Seems kinda weird for it not to meet the definition in a tautological way even if it’s not the typical sense or doesn’t tend to be used for autoregressive token generation?
- uoaei 11mo agoIs it Transformer-based? If not then it's a different beast architecturally. Audio models tend to be based more on convolutional layers than Transformers in my experience.
- big_toast 11mo agoThe openai/whisper repo and paper referenced by the model card seem to be saying it's transformer based.