4 ms·
They link to this repo at the top of the paper https://github.com/microsoft/unilm https://github.com/microsoft/unilm although I don't see anything that actually
by ilaksh 4y ago
They link to this repo at the top of the paper https://github.com/microsoft/unilm https://github.com/microsoft/unilm although I don't see anything that actually says "Kosmos".
Slightly interestingly, the last commit changes a heading from "AI" to "AGI" https://github.com/microsoft/unilm/commit/bbbb5b4b06c2dd501d9e55f690685e723d4e498c https://github.com/microsoft/unilm/commit/bbbb5b4b06c2dd501d...
The model is relatively small, 1.6B. I am guessing the goal is to be able to run on a user's home PC. But it would be interesting to see how much better it gets if you scale it up by a factor of 10 or 100.