> If I ask for a red box on top of a blue box The model has to encode those words into a fixed length vector, an architectural design decision, not an inherent

> If I ask for a red box on top of a blue box The model has to encode those words into a fixed length vector, an architectural design decision, not an inherent requirement. For example translation systems can translate such phrases perfectly, but they don't pass the representation through a single vector bottleneck.