Unified embeddings show an example of sacrificial training techniques, techniques that add parameters at train time that improve training performance but can be

Unified embeddings show an example of sacrificial training techniques, techniques that add parameters at train time that improve training performance but can be removed for prod so no impacts to prod code/weight structure.