4 ms·Why 768? What are these dimensionsby unbanned 5y agoWhy 768? What are these dimensionslaingc 5y agoIt comes from the dimensionality of the hidden state of popular NLP models. The number 768 in particular comes from (if I recall correctly) the largest of the original BERT models.unbanned 5y agoSo it's arbitrary then