8 ms·
Harvard: Student Use Cases for AI
- makk 3y agoThere are examples of really long, multi-step prompts in that series of articles. Is GPT-4 good at following those in practice?
- dartos 3y agoFrom what I’ve seen, yes generally. You need to tinker the prompt to get it to follow the instructions all the time, but usually it’s pretty good about it. Take a look at chain-of-thought prompting or the reAct paper for some research into it.
- rmbyrro 3y agoIt depends on the total context of the conversation. As the number of tokens grow, it starts to lose track. Usually it's noticeable and you can remind it of what it's missing.
- nomel 3y agoFrom my experience, these types of prompts are only good for three or four responses/follow ups, then it somewhat quickly "degrades" to more standard behavior, forgetting the detailed instructions.
- fudged71 3y agoI think it's possible in a prompt for the LLM to remind itself of it's purpose in its own responses, creating a sort of flywheel effect. If you use a longer context window model (16k, 32k, 100k) this shouldn't be as much of a problem.
- rmbyrro 3y agoI was surprised about the quality of this guide. Really thoughtful and well crafted. Goes from solid premises and goals, moving towards practical use of LLMs to accomplish them.
- magoghm 3y agoFor the last few months Ethan Mollick has been writing some great articles about how to best use Generative AI in his blog: https://www.oneusefulthing.org/ https://www.oneusefulthing.org/
- a_wild_dandan 3y agoGuess I'll give the article another shot then. I immediately closed the page because it looked like this: https://i.imgur.com/W69BSiP.png https://i.imgur.com/W69BSiP.png EDIT: never mind. They broke Reader Mode. I give up.
- fudged71 3y agoThe author Ethan Mollick has been doing some of the most in-depth testing of LLMs that I've seen (on Twitter). I highly recommend following as he's found quirks and use cases with LLMs earlier than a lot of more technical prompt engineers.
- skipants 3y agoI think it could really use some prompt or workflow examples. It mentions pressing the LLM for more information and to explain itself, which could be demonstrated using some prompts. edit: Oh my mistake -- I didn't realize that the links in the article lead into more articles that do have examples.
- whimsicalism 3y agoCan we remove "Harvard:" from the title? It is editorializing contrary to HN guidelines and this is not an official position of Harvard but rather an article published by Harvard Business Publishing (not written by Harvard faculty).
- deleted 3y ago[deleted]
- PcChip 3y agoThis is really well thought out, it's refreshing to see guidelines of this quality - I hope this article spreads far and wide
- lacker 3y agoThis article is avoiding the elephant in the room. From talking to students it is quite clear to me that the main student use case for AI is as a homework assistant. You tell ChatGPT your homework question and ask what's the answer. In some cases ChatGPT will simply give you the perfect answer and there's nothing more you need to do. In some cases ChatGPT will give you an incomplete answer and you need to finish it up yourself. Often here asking some followup related questions will be quite useful. In some cases ChatGPT will give you a subtly wrong answer and you need to figure that out. I think the toughest ethical situations arise when ChatGPT can give you a perfect answer to your homework problem. Is it unethical for a student to use ChatGPT in this case? Does superficially rewriting the answer to put it in your own words make it ethical? Is it appropriate for professors to give out A's to the students who cut and paste from GPT4, while giving lower grades to students who don't realize that such a tool is available, or who won't pay $20/month for the best homework tool?
- knicholes 3y agoPersonally I think it just comes down to the student cheating themselves. If they're in a job interview and don't have ChatGPT handy AND they've been using ChatGPT to get answers directly instead of asking how to arrive at the answer, I think they're going to have a hard time getting that job. However, if they always have ChatGPT available and can always get the right answers (either by luck, prompt engineering skills, or an ability to determine if an answer is correct), I don't see them having a hard time competing in the workplace at all for most commonly solved problems. Hopefully the teacher would do a sufficient job teaching such that if the non-ChatGPT-using student puts forth adequate effort, they'll be able to get the answers as well, but maybe not as quickly as those using ChatGPT.
- foobarian 3y agoAnd then the kid who refrained from cheating themselves by using ChatGPT arrives at the job interview, gets asked to answer a bunch of difficult questions with the help of ChatGPT, and fails because of lack of modern computer skills. :-)
- WendyTheWillow 3y ago
- nomel 3y agoRelated to tutor, I've been playing a "game" lately with ChatGPT-4. I will give it a prompt resembling "You are a tutor. You will guide me to understand a topic, without giving me direct answers. I will guess how something works, and you'll give small hints for what I should explore further, or reconsider. The concept is: electrorheological materials." Even without AI, this is one of my favorite things to do, and easiest way to learn, where I guess, with as much detail as I can, and then dive into reference material to see how close I was. I've had a few car rides now with the iOS app's conversation mode doing this. AI is the clearly the future of education, in my opinion.
- 2devnull 3y agoUltimately history books are written by the winners. So the question is not whether ai will be the future, but which ai will be the future. From that perspective, it’s just more of the same old same old top down.
- ihaveajob 3y agoA similar, more passive approach is to tell the AI to conjure 3 or 4 personas representing the main points of view about a particular topic (i.e. "universal basic income"). Each persona is an eloquent expert in the field with a strong opinion aligned with each of the PoVs. Then I ask them to debate the topic. Really insightful stuff.
- capableweb 3y agoThat's a fun way I hadn't considered, thanks! For the ultimate version of this, once locally trained and running LLMs becomes a bit more feasible (meaning, closer to GPT4), it would be a fun exercise to train various models with personas and let them hash it out until they all agree on something. One model could be trained on HN, another on a specific Facebook user group (like "Moms against video games"), another on Twitter on so on, then you let them come together until they've reached consensus (or not).
- ctoth 3y ago
- tomjen3 3y agoI can see that one of the authors of the guide is Ethan Mollick. He has a free substack with more AI advice. You may find his own guide very useful (https://www.oneusefulthing.org/p/how-to-use-ai-to-do-stuff-an-opinionated https://www.oneusefulthing.org/p/how-to-use-ai-to-do-stuff-a...). This is aimed at a more general audience.
- sailfast 3y agoPedantic: this is published by Harvard Business School Publishing, but the contents are by two authors from Wharton / Penn.
- CobrastanJorji 3y ago> If it gives you a number or fact, assume it is wrong unless you either know the answer or can check with another source. Meanwhile, every search engine, startup, and tech company: "Quick, put this in front of customers and stamp our logo under it!"
- palata 3y agoAlso... how does it have any value then? Either I should ignore it (in which case ChatGPT was useless) or I already know it from a trustworthy source (in which case ChatGPT was useless).
- palata 3y agoOne of the most important lessons I got from high school came from my history teacher: instead of testing that we had learned the book by heart and were able to "copy-paste" the right parts into our test, she was looking for critical thinking. In a typical test, she would give us all kind of articles (with the source: date, author, journal, country, etc) and ask us to analyze it. Not only it required us to understand the historical context ("the author is talking about this event that happened at this place for this reason"), but we had to show critical thinking: "he comes from this country and has this religion, so I would assume that he has a bias towards this", etc. To the point where we could even choose which questions we wanted to answer in the test. "It's okay to have completely forgotten about this event, just pick a question about some historical context you know". She was not testing our capacity at learning everything by heart (of course we had to learn something, otherwise we could not answer any question at all). It took her time to establish that. Many students hated her, because they would usually easily make good grades by "learning the book by heart", and they were failing here. But at least for me, when I started understanding how it worked I also started loving this class. Somehow I did not feel like another pointless class where I would optimize my grades: I was actually improving my critical thinking. I was getting something out of this class other than good grades. Reading my history book now was not about learning facts, but trying to understand the context through the lens of the author. I think that every teacher should strive to give that kind of feeling to their students. Then ChatGPT would not be a problem anymore: it becomes clear that it is not trustworthy. If some like to use it as a tool (e.g. because they need ChatGPT to give them keywords that they can use in further research), that's fine. Those who take the output of ChatGPT for granted have just missed the point, they may as well do nothing.
- dopidopHN 3y agoJust for context, what you describe is standard end of high school history test in France.
- musicale 3y agoI don't think those are the use cases that most students are interested in (emphasis mine): "If you are looking for ways to use ChatGPT to support or replace your writing, here are five different ways to explore." https://www.zdnet.com/article/how-to-use-chatgpt-to-write-an-essay/ https://www.zdnet.com/article/how-to-use-chatgpt-to-write-an...