7 ms·
Edge AI for Beginners
- arresin 1y agoThey are really embracing ai! I can feel them all around even. Above me. Below me.
- alansaber 1y agoAlways cool to see SLM support from a big company, albeit for inference
- brazukadev 1y agoProbably Goodhart's law
- coolKid721 1y ago[flagged]
- yalogin 1y agoIsn’t edge AI just a way to deploy AI to meet product requirements? What is special about this course? Is Microsoft trying to sell this as a service? If so what is the revenue model and hardware used?
- fishmicrowaver 1y agoMS GitHub seems to be featuring a lot of beginners courses all at the same time. Wonder if they're just pumping them out with AI at this point.
- geraldwhen 1y agoSeems to be. There’s little chance this was written by a human.
- nurettin 1y agoThere's little chance this was even seen by a human.
- discordance 1y agoYou may be underestimating how many people work at Microsoft on documentation and course related material.
- Anamon 1y agoIsn't it 0? I've heard MS outsourced all of their development documentation work. And personal everyday experience, I'd say it shows.
- btown 1y agoIt seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers (https://workers.cloudflare.com/ https://workers.cloudflare.com/). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/Module01/01.EdgeAIFundamentals.md https://github.com/microsoft/edgeai-for-beginners/blob/main/...: > EdgeAI represents a paradigm shift in artificial intelligence deployment, bringing AI capabilities directly to edge devices rather than relying solely on cloud-based processing. This approach enables AI models to run locally on devices with limited computational resources, providing real-time inference capabilities without requiring constant internet connectivity. (This isn't necessarily just Microsoft's definition - https://www.redhat.com/en/topics/edge-computing/what-is-edge-ai https://www.redhat.com/en/topics/edge-computing/what-is-edge... from 2023 defines edge computing as on-device as well, and is cited in https://en.wikipedia.org/wiki/Edge_computing#cite_note-35 https://en.wikipedia.org/wiki/Edge_computing#cite_note-35) I suppose that the definition "edge is anything except a central data center" is consistent between these two approaches, and there's overlap in needing reliable ways to deploy code to less-trusted/less-centrally-controlled environments... but it certainly muddies the techniques involved. At this rate of term overloading, the next thing you know we'll be using the word "edgy" to describe teenagers or something...
- pclmulqdq 1y agoYeah, Cloudflare is in the minority with their definition of "edge."
- vlovich123 1y agoNo, edge is just poorly defined. Plenty of companies call their servers “edge” because they’re collocated with ISPs. Even ISPs when they talk about edge compute aren’t talking about your laptop but about compute in their colo.
- notatoad 1y agoedge just means as close to the user as you can get. microsoft's edge is closer to the user than cloudflare's edge or an ISP's edge because microsoft runs your laptop.
- gl-prod 1y agoIt's funny that they used AI to translate into other languages, because the Arabic cover image is just gibberish.
- flexagoon 1y agoIn Russian, the cover image says "Al" (with an L) instead of AI, and on the little CPU icon in the corner "AI" just got replaced with "A". Edit: seems like it's like that in most languages lol, at least those with a latin script
- gl-prod 1y agoIt looks like a box with new text inserted over the original image
- thenthenthen 1y agoOh this is hilarious, it is like they used Google Lens like method of translating (overlay the translation, you can see the text blocks). In the Dutch one, the cpu AI text just reads: ‘een’ aka ‘a’ in English
- layoric 1y agoInterestingly the French is completely different. https://github.com/microsoft/edgeai-for-beginners/blob/main/translations/fr/README.md https://github.com/microsoft/edgeai-for-beginners/blob/main/...
- tdhz77 1y agoNot comfortable with the phrase edge ai.
- TZubiri 1y agoGoogle has a similar product with Vertex
- doctoboggan 1y agoThe very first sentence: > Welcome to EdgeAI for Beginners – your comprehensive... Em dash and the word "comprehensive", nearly 100% proof the document was written by AI. I use AI daily for my job, so I am not against its use, but recently if I detect some prose is written by AI it's hard for me to finish it. The written word is supposed to be a window into someone's thoughts, and it feels almost like a broken social contract to substitute an AI's "thoughts" here instead. AI generated prose should be labeled as such, it's the decent thing to do.
- lxgr 1y agoOr just by somebody that knows how to use English punctuation properly. Is it so hard to believe that there are some people in the world capable of hitting option + “-“ on their keyboard (or simply let their editor do it for them)?
- doctoboggan 1y agoI said em dash _and_ the word comprehensive. If you work with LLM generated text enough it gets very easy to see the telltale signs. The emojis at the start of each row in the table are also a dead giveaway. I am guessing you are one of those people who used em dashes before LLMs came out and are now bitter they are an indicator of LLMs. If that's the case, I am sorry for the situation you find yourself in.
- accoil 1y agoIf it makes a difference: it's an en dash used in the readme. I've been wondering why LLMs seem to prefer the em dash over en dash as I feel like en (or hyphen) is used more frequently in modern text.
- schrodinger 1y agoIn my experience the em dash is still correctly used, the modern style has just evolved to put a space around it. So: * fragment a—fragment b (em dash, no space) = traditional * fragment a — fragment B (em dash with spaces) = modern * fragment a -- fragment b (two hyphens) = acceptable sub when you can’t get a proper em to render But en-dashes are for numeric ranges…
- iJohnDoe 1y agoWhat are the best Small Language Models (SLMs) these days?
- jerpint 1y agoBest is very subjective depends what you want it to do and if you want to fine tune and how big you consider small
- ArcHound 1y agoLet me ask the same with: - runs on a laptop CPU - decide if a long article is relevant to a specified topic. Maybe even a summary of the article or picking the interesting part as specified in prompt instructions. - no fine tuning please. Thank you for any response!
- iJohnDoe 1y agoRuns on a laptop. Good at friendly conversational dialogue.
- gloosx 1y agoHmm, why do they ask to fork it first and then clone the original repo?
- walrusted 1y agoneed to edge before you fork? if lucky you clone
- rmccrear 1y agoI clicked hoping the models would be available in the “Edge” browser.
- liamkearney 1y agoTL;DR This is a course on how to use Microsoft compute to maximise their profits
- tkzed49 1y agoToo long for you to read? It's about running AI on local devices
- rocauc 1y agoOne of the most common uses for edge AI not listed in this course is computer vision. You similarly want real-time inference for processing video. Another open source project that makes it easy to use SOTA vision models on the edge is inference: https://github.com/roboflow/inference https://github.com/roboflow/inference
- nivter 1y agoThis is far from what I expected. There is not much related to quantization, pruning, common architectures, precision or benchmarking. For those interested in this topic, I would recommend content from MIT HAN Lab.
- keyle 1y agoCan you provide links or more information?
- soumendrak 1y agoMay be this one: https://hanlab.mit.edu/courses/2024-fall-65940 https://hanlab.mit.edu/courses/2024-fall-65940
- nivter 1y agoYoutube: https://www.youtube.com/@MITHANLab https://www.youtube.com/@MITHANLab Course: https://hanlab.mit.edu/courses/2024-fall-65940 https://hanlab.mit.edu/courses/2024-fall-65940
- jbrooks84 1y agoThis was made by AI
- netfortius 1y agoI remember when we bought and installed, among the first in the world, the AWS Outpost, sold as an "edge" (of in between cloud and on prem) infrastructure product. Same term has been previously (ab)used also in the security space, at - again - the confluence between cloud and on-prem. And then - yet one more time - the "edge" was a closer data center for localized delivered cloud services.
- porridgeraisin 1y agoI would say this is a poor beginners guide for quantization/compression, it's mostly an API guide for tf/keras quantization APIs it doesn't tell the beginner why or when or which layers (and why) they should apply it to. But the modules that compare the different model families are quite good. As are the remaining modules that are "How to deploy to $platform 101", including microsoft's, of course ;) Not that I have a better resource at hand for quantization/compression _for beginners_, and I am probably a bad judge for how beginner friendly Song Han's TinyML course was...
- mapleoin 1y agoThis looks like AI slop to me. The first two modules repeat the benefits of Edge AI five times. The "Practical Implementation Guide" https://github.com/microsoft/edgeai-for-beginners/blob/main/Module01/03.PracticalImplementationGuide.md https://github.com/microsoft/edgeai-for-beginners/blob/main/... ends with a Pre-course checklist. The whole article is just mini-examples without enough context to understand anything.
- diamond559 1y agoThank you Microsoft, my llm phishing agents have never been more profitable. Scamming w/ "AI" is the future my friends!
- walrusted 1y agoIs this a Craigslist post from 2007? or just Slopai seconds?