4 ms·
Compressing Large Language Models Using Low Rank and Low Precision Decomposition
- westurner 2y agoScholarlyArticle: "Compressing Large Language Models Using Low Rank and Low Precision Decomposition" (2024) https://arxiv.org/abs/2405.18886 https://arxiv.org/abs/2405.18886 : > CALDERA NewsArticle: "Large language models can be squeezed onto your phone — rather than needing 1000s of servers to run — after breakthrough" (2024) https://www.livescience.com/technology/artificial-intelligence/large-language-models-can-be-squeezed-onto-your-phone-rather-than-needing-1000s-of-servers-to-run-after-breakthrough https://www.livescience.com/technology/artificial-intelligen... :