3 ms·

But generating new prompts for GPT is incredibly cheap! You just rephrase and ask again. That there are prompts which generate impressive results with GPT is t

But generating new prompts for GPT is incredibly cheap! You just rephrase and ask again. That there are prompts which generate impressive results with GPT is the point. Because anyone can generate prompts - and get impressive results. Whereas hyper parameter tuning is expensive. A system that generates good results with the right tuning doesn’t tell you much about your ability to use it to generate good results, because it will be hard to try lots of different tuning approaches to discover if you can get a useful result. These things seem not remotely comparable.

akkartik 4y ago
Think about when you use GPT to generate prompts, something that seems to be growing common. Once you have a pipeline like that, changing the (meta)prompt can be expensive. You designed the pipeline thinking you only have to come up with the meta-prompt once, and it would work from now on. But you find you have to keep tuning your Kubernetes/upgrading your dependencies/tweaking your meta prompt. "Scam" is overblown, but I think OP is right to warn of a possible future issue. It's an issue endemic to all software, so not something worth calling out recent AI advances in particular for. But it seems something we should all be trying to get better about. Monitor the ongoing costs of the systems we create. Do they really pay for themselves or are we waiting for a Godot that never arrives?