What kind of bottleneck are you talking about? VAEs as such are really in a different category from transformers. They are primarily a tool to get to more struc

What kind of bottleneck are you talking about? VAEs as such are really in a different category from transformers. They are primarily a tool to get to more structured latent spaces, which is not something transformers are good at in the first place.