3 ms·
I think that may be wrong. PaLM was 540B, but I don't think PaLM2 is near that. Perhaps 120B like Galactica large, but afaik they don't say.
by chaxor 3y ago
I think that may be wrong. PaLM was 540B, but I don't think PaLM2 is near that. Perhaps 120B like Galactica large, but afaik they don't say.
- ftxbro 3y agoI think you are right, and the quote from article we are commenting here is wrong. From the PaLM technical report: "The largest model in the PaLM 2 family, PaLM 2-L, is significantly smaller than the largest PaLM model but uses more training compute."