3 ms·
That’s an interesting idea. What do you mean? I understand the prompts as a service is short term… but what is a long term product you see?
by sunir 2y ago
That’s an interesting idea. What do you mean?
I understand the prompts as a service is short term… but what is a long term product you see?
- redblacktree 2y agoI may be misunderstanding your meaning, but I'm not convinced that "prompts as a service" is short term. I think we'll see a number of apps pop up that will be essentially that, i.e. powered by a generative AI, but with a great UX. Not everyone is good at prompting, and although it is a skill many will develop, packaging up great prompts in niche problem areas still looks like an area of opportunity to me. I'm not talking necessarily about chat experiences, but apps that can, as an example, maintain task lists for you after consuming your incoming communications.
- objektif 2y agoHow many times did you have issues communicating with your spouse because of prompting issues? And how did you resolve it? Why would you need an extra layer here?
- malnourish 2y agoWhy do PR firms and copy editors exist?
- redblacktree 2y agoI don't understand your comment. I was talking about apps built on LLMs where the prompts aren't given by the users, but the LLM is still an important part of the functionality.
- objektif 2y agoI am trying to say in the very near future LLMs will be smart enough to not necessitate a middle man for prompt experimentation.
- jstummbillig 2y agoI think a general way to answer this is by considering for any domain you know: What would you pay a human to do right now, that LLMs frustratingly can't, but should in theory, if only they were a bit better and more consistent? This could mean: Instead of diving into langchain and trying to program your way out of a bad model, or trying to do weird prompts, just write a super clear set of instructions and wait for a model that is capable of understanding clear instructions, because that is an obvious goal of everyone working on models right now and they are going to solve this better than your custom workaround can. This is not a rigid rule, just a matter of proportions. For example, you should probably be willing to try a few weird intermediary prompt hacks, if you want to get going with AI dev right now. But if most of what most people do will probably be solved by a somewhat better model, that's probably a cause for pause.
- mercer 2y agoI suppose with an eye on open-source, an interesting 'rule' would be to set a cut-off point for models that can run locally, and/or are considered to be feasible locally soon.