8 ms·
More Efficient In-Context Learning with Generalist Language Model (GLaM) on the Google blog (2021): https://archive.is/cuyW0 https://archive.is/cuyW0 Btw, MoE
by ignoramous 3y ago
More Efficient In-Context Learning with Generalist Language Model (GLaM) on the Google blog (2021): https://archive.is/cuyW0 https://archive.is/cuyW0
Btw, MoE is one of the 5 other ways Google thinks LLMs can be more efficient: https://archive.is/2XMvh https://archive.is/2XMvh