4 ms·
Summary: It's cheaper, safer for handling sensitive data, easier to reproduce results (only way to be 100% sure it's reproduce even, as "external" models can ch
by diggan 2y ago
Summary: It's cheaper, safer for handling sensitive data, easier to reproduce results (only way to be 100% sure it's reproduce even, as "external" models can change anytime), higher degree of customization, no internet connectivity requirements, more efficient, more flexible.
- alexander2002 2y agoAn AI chip on laptop devices would be amazing!
- ta988 2y agoThey already exist. Nvidia GPUs on laptops, M series CPUs from Apple, NPUs...
- alexander2002 2y agooh damn guess i am so uninformed
- viraptor 2y agoIt's pretty much happening already. Apple devices have MPS. Both new Intels and Snapdragon X have some form of NPU.
- moffkalast 2y agoIt would be great if any NPU that currently exists was any good at LLM acceleration, but they all have really bad memory bottlenecks.
- aurareturn 2y agoFirst NPU arrived 7 years ago in an iPhone SoC. GPUs are also “AI” chips. Local LLM community has been using Apple Silicon Mac GPUs to do inference. I’m sure Apple Intelligence uses the NPU and maybe the GPU sometimes.
- bionhoward 2y agoNo ridiculous prohibitions on training on logs… Man, imagine being OpenAI and flushing your brand down the toilet with an explicit customer noncompete rule which totally backfires and inspires 100x more competition than it prevents
- roywiggins 2y agoLlama's license does forbid it: "Llama 3.1 materials or outputs cannot be used to improve or train any other large language models outside of the Llama family." https://llamaimodel.com/commercial-use/ https://llamaimodel.com/commercial-use/
- ronsor 2y agoMeta dropped that term, actually, and that's an unofficial website.
- candiddevmike 2y agoIt's still present in the llama license...? https://ai.meta.com/llama/license/ https://ai.meta.com/llama/license/ Section 1.b.iv
- jerbear4328 2y agoLlama 3.1 isn't under that license, it's under the Llama 3.1 Community License Agreement: https://www.llama.com/llama3_1/license/ https://www.llama.com/llama3_1/license/
- sigmoid10 2y ago>If you use the Llama Materials to create, train, fine tune, or otherwise improve an AI model, which is distributed or made available, you shall also include “Llama 3” at the beginning of any such AI model name. The official llama 3 repo still says this, which is a different phrasing but effectively equal in meaning to what the commenter above said.
- 2y ago