7 ms·
Generative AI for Beginners
- arachp_braijik 3y ago[flagged]
- kristiandupont 3y agoI wrote this blog post [link redacted] which seems to be a more brief introduction to some of these concepts. I guess the assistant API has changed the landscape but even that must be using some of these techniques under the hood, so I think it's still fascinating to study.
- ParetoOptimal 3y agoI enjoyed your post, but I don't see how it compares given there isn't much "how-to".
- kristiandupont 3y agoI guess that's fair, it's more about the concepts. I will say that I would have liked to have read something like it before starting the project, it would have made the journey (which I have still only just started) quite a bit easier.
- deleted 3y ago[deleted]
- bob1029 3y agoI used the assistant API for about 2 weeks before I realized I could do a better job with the raw completion API. For me, the Assistant API now feels like training wheels. The manner in which long threads are managed over time will be domain-specific if we are seeking an ideal agent. I've got methods that can selectively omit data that is less relevant in our specific case. I doubt that OAI's solution can be this precise at scale.
- vorticalbox 3y agoI've noticed the assistents api is a lot slower and the fact you need to "poll" for when a run is completed is annoying. There a few good points though, you can tweat the system document on the dashboard without needing to re start the app and you can switch which model is being used too.
- bob1029 3y ago> the fact you need to "poll" for when a run is completed This is another good point. If everything happens in one synchronous call chain, it's likely to finish in a few seconds. With polling, I saw some threads take up to a minute.
- simonw 3y agoAs far as I can tell this doesn't mention prompt injection at all. I think it's essential to cover this any time you are teaching people how to build things on top of LLMs. It's not an obscure concept: it's fundamental, because most of the "obvious" things people want to build on top of LLMs need to take it into account. UPDATE: They've confirmed that this is a topic planned for a forthcoming lesson.
- zerkten 3y agoCreate an issue at https://github.com/microsoft/generative-ai-for-beginners https://github.com/microsoft/generative-ai-for-beginners. There is a call to action for feedback and looks like at least one of the contributors are in education, so will probably take the feedback on board.
- simonw 3y agoDoing that now, thanks. Opened an issue here: https://github.com/microsoft/generative-ai-for-beginners/issues/203 https://github.com/microsoft/generative-ai-for-beginners/iss...
- simonw 3y agoGood news in a reply to that issue: > We are working on an additional 4 lessons which includes one one prompt injection / security
- deleted 3y ago[deleted]
- BoorishBears 3y agoI feel like prompt injection is getting looked at the wrong way: with chain of thought attention starts being applied to the user input in a fundamentally different way than it normally is If you use chain of thought and structured output it becomes much harder to successfully prompt inject, since any injection that completely breaks the prompt results in an invalid output. Your original prompt becomes much harder if not impossible to leak in a valid output structure, and at some steps in the chain of thought user input is hardly being considered by the model assuming you've built a robust chain of thought for handling a wide range of valid (non-prompt injecting) inputs. Overall if you focus on being robust to user inputs in general, you end up killing prompt injection pretty dead as a bonus
- echelon 3y agoI skimmed this, but it's all "which LLM is best for you? One from OpenAI!" and "Ready to deploy your app, get started on Azure!" This is marketing too.
- deleted 3y ago[deleted]
- UncleEntity 3y agoEveryone + dog is adding "AI" to their products and "nobody ever got fired by buying Microsoft" so...
- charcircuit 3y agoWhy would someone be fired over what company they bought an LLM from?
- kortilla 3y agoBecause if your product sucks and can be traced to using an unproven LLM, you will get the blame for betting on an unknown.
- charcircuit 3y agoIt is trivial to swap LLM considering most LLM are compatible with the OpenAPI API.
- deleted 3y ago[deleted]
- nullptr_deref 3y agoI am just curious. Please explain it to me. 1. Who are beginners? All of these concepts are so apparent to most of the grad students/those following this scene extremely closely, yet they can't find a job related to it. So does it make them beginners? 2. These are such a generic use cases that don't define anything. It is literally software engineering wrapped around an API. What benefit does the "beginner" get? 3. So are these biased to some exceptionally talented people who want to reboot their career as "GenAI" X (X = engineer/researcher/scientist) 4. If there are only open positions in "generative AI" that requires PhD, why are there materials such as this? Who is it targeted to and why do they exist? 5. Most of the wrapper applications have short life-span. Does it even make sense to go through this? 6. What does it mean for someone who is entrenched into the field? How are they going to differentiate from these "beginners"? 7. What is the point to all of this when it is becoming irrelevant in next 2 years?
- deleted 3y ago[deleted]
- layer8 3y agoThe point is to hook people who want to “do AI” into Microsoft’s cloud API ecosystem.
- dr_kiszonka 3y agoIt seems to me that this course introduces Python devs to building gen text applications using Open AI's models on Azure. And I don't mind it - some folks will find it useful.
- toddmorey 3y agoI don't think this course is for machine learning grad students, I think Microsoft is trying to create materials for someone interested in using ML/AI as part of developing an application or service. I've only skimmed the course here, but I do think there's a need for other developers to understand AI tooling, just as there became a need for developers to understand cloud services. I support those building with any technology taking the time to understand the current landscape of options and develop a high mental model around how it all works. I'll never build my own database engine, but I feel my learnings about how databases work under the hood have been worth the investment.
- vegabook 3y agoI liked Stephen Wolfram's piece. https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
- modernpink 3y agoThat's fine, but this post is for a course on developing generative AI applications.
- lacrimacida 3y agoDeveloping generative AI ‘application’ on microsoft’s land and terms. A lot of concepts here tie one to microsoft. The OPs post is a good conceptual primer that isn’t mentioned or explained in this tutorial.
- voiceblue 3y ago> A lot of concepts here tie one to microsoft. You're not kidding, they tout their "Microsoft for Startups" offering but you cannot even get past the first step without having a LinkedIn. On another note, OPs post above (not TFA) may as well be taglined "the things OpenAI and Microsoft don't want you to see" - I'm willing to bet that it will be a long, long time before Microsoft and OpenAI are actually interested in educating the public (or even their own customers) about how LLMs actually work - the ignorance around this has played out massively to their favor.
- echelon 3y ago> this post is for a course on developing generative AI applications Using Microsoft/OpenAI ChatGPT and Azure. There's a much wider world of AI, including an extremely rich open source world. Side note: it feels like the early days of mobile. Selling shovels to existing companies to add "AI". These won't be the winners, but rather products that fully embrace AI in new workflows and products. We're still incredibly early. As far as the tool makers go, there are so many shovels being sold that it looks like it'll be a race to zero margin. Facebook announced Emu, and surprise, next day Stable Video comes out. ElevenLabs raised $30M, all of their competitors did too, and Coqui sells an on-prem version of their product. Maybe models are worth nothing. Maybe all the value will be in how they're combined. This field is moving so fast. Where will the musical chairs of value ultimately stop and sit?
- _joel 3y agoAnything similar for open source?
- mark_l_watson 3y agoOn Mac Silicon, try Ollama as a means to easily download and run open LLMs.
- dharmab 3y agoAlso works great on Linux if you have a high end desktop CPU.
- mark_l_watson 3y agoAfter reading your comment, I spent a few minutes getting Ollama running on Google Colab - works great. First time I tried it on Linux + Intel.
- politelemon 3y agoProbably this because it's a simple UI to get you started: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
- dharmab 3y agoNot a guide, but https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui is a sandbox application for generating AI images locally with a very active community.
- dyno12345 3y agoI just want to inpaint but am finding that surprisingly difficult
- k12sosse 3y agoA1111 img2img inpaint works pretty well, if you get a checkpoint that matches the style you're inpainting. Civitai [0] can be a good resource here, and it's not just for perverts.. I swear! ;) [0] https://civitai.com/articles/161/basic-inpainting-guide https://civitai.com/articles/161/basic-inpainting-guide
- deleted 3y ago[deleted]
- Dudester230602 3y agoIsn't this merely teaching how to be a script/prompt monkey?
- anamexis 3y agoIsn't this merely a dismissive comment that doesn't offer any value?
- Dudester230602 3y agoIndeed it is. You are a true master of self-referencing phrases!
- CamperBob2 3y agoWe're all monkeys now.
- temp0826 3y agoOT- there should be a "cloud to butt" extension for "AI to LLM"
- shrimpx 3y agoAndrej Karpathy's "Zero to Hero" series on YouTube is the ultimate guide to building LLMs. Extremely information-dense but as complete as it gets: https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs... Also, an amazing high-level overview of LLMs, including extensive discussion about attack vectors, that he published a couple days ago: https://www.youtube.com/watch?v=zjkBMFhNj_g https://www.youtube.com/watch?v=zjkBMFhNj_g
- deleted 3y ago[deleted]
- grammers 3y agoThis reads too much like marketing, don't really get why it's here.
- phillipcarter 3y agoWhat comes off as marketing? I skimmed through the content and it's fairly comprehensive content for technical people looking to dive into the tech for the first time.
- schnitzelstoat 3y agoThis seems more of a course about how to use Generative AI - does anyone have a good recommendation of a course or book about how they actually work?
- mstibbard 3y agohttps://course.fast.ai https://course.fast.ai https://karpathy.ai/zero-to-hero.html https://karpathy.ai/zero-to-hero.html Both fantastic.
- jmacd 3y agoThis Intro to Transformers is helpful to get some basic understanding of the underyling concepts and it comes with a really succint history lesson as well. https://www.youtube.com/watch?v=XfpMkf4rD6E https://www.youtube.com/watch?v=XfpMkf4rD6E
- wsgeorge 3y agoKaparthy uploaded a 1hr talk to YouTube recently: https://www.youtube.com/watch?v=zjkBMFhNj_g https://www.youtube.com/watch?v=zjkBMFhNj_g
- smokel 3y agoIt depends on your level of expertise. Andrew Ng's courses on Coursera are helpful to learn about the basics of deep learning. The "Generative AI for Everyone" course and other short courses offer some basic insight, and you can continue from there. https://www.coursera.org/specializations/deep-learning https://www.coursera.org/specializations/deep-learning https://www.deeplearning.ai/courses/generative-ai-for-everyone/ https://www.deeplearning.ai/courses/generative-ai-for-everyo... HuggingFace has some nice courses as well: https://huggingface.co/learn/nlp-course/ https://huggingface.co/learn/nlp-course/ Jay Allamer has a nice blog post on the Transformer architecture: https://www.deeplearning.ai/short-courses/ https://www.deeplearning.ai/short-courses/ And eventually you will probably end up reading papers on arxiv.org :)
- eurekin 3y agoI watched things mentioned in sibling comments, but didn't help. Until I found this: https://www.youtube.com/@algorithmicsimplicity https://www.youtube.com/@algorithmicsimplicity Instantly clicked. Both convolution and transformer networks. EDIT: for the purpose of visualization, I highly recommend following channel: https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s It nicely explains and shows concepts of stride, features, window size, input to output size relation - in convolutional NN
- deleted 3y ago[deleted]
- huqedato 3y agoAzure marketing. Gross!
- juunpp 3y agoThis is bullshit and should be titled "How to use our API token for beginners".
- andreygrehov 3y agoIs there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.
- outside1234 3y agoDo you want to USE it or BUILD it? If the later, ChatGPT's recommendations are a good start. If the former, courses like this one are a good start.
- andreygrehov 3y agoBuild. Thank you.
- pixelatedindex 3y agoCould you elaborate a little more on the “ChatGPT’s recommendations” part? Do you mean asking ChatGPT how to build or something else? I have 0 clue about AI/ML as well. I feel like the world has left me behind and all I know is REST APIs and some basic GraphQL.
- jholman 3y agoGP> ChatGPT recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. Parent> If you want to learn to BUILD AI, ChatGPT's recommendations are a good start you> what did ChatGPT recommend? I think your token window is a bit too small.
- pixelatedindex 3y agoThat was a needle wrapped in a cotton ball, ouch. Point taken.
- famahar 3y agoWith the rate things are improving and all the new paradigms being explored, I feel like this course will be outdated fast. I learned about generative AI 2 years ago and all the tools I used then are outdated.
- globalnode 3y agofrom microsoft, no red flags there
- paxo 3y agountil you realize this is an ad for azure
- ajikimchi 3y agoI think this is more than needed for beginner
- ashu1461 3y agoWell this is good, but like most of the content on the internet on LLM applications this is for beginners, any good sources for intermediate reading ?
- otteromkram 3y agoFrom within that very article: > After completing this course, check out our Generative AI Learning collection to continue leveling up your Generative AI knowledge! (There's a link in the statement that I didn't include here.)
- tarruda 3y agoIf you're looking for a practical guide on how to use LLMs, highly recommend "Hackers Guide to language models" by Jeremy Howard. 1.5h video packed with practical information: https://youtu.be/jkrNMKz9pWU https://youtu.be/jkrNMKz9pWU
- skinowski 3y agoSeems like this requires Azure OpenAI access which is not granted for personal use but only for select corporate customers?
- biaass22223353 3y ago[dead]