3 ms·
> Facebook released over 100 pages of notes a few months ago detailing their training process for a model that is similar in size. Does anyone have a link? Is
by ninjaranter 4y ago
> Facebook released over 100 pages of notes a few months ago detailing their training process for a model that is similar in size. Does anyone have a link?
Is https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf https://github.com/facebookresearch/metaseq/blob/main/projec... what you're referring to?
- dave_sullivan 4y agoYes! Thank you! Very good read for anyone interested in the field.