7 ms·
I wonder if these "Thank you"s are actually reaching the inference servers. While the answers are somewhat customized, they end with a standard sentence, and co
by qwertox 3y ago
I wonder if these "Thank you"s are actually reaching the inference servers. While the answers are somewhat customized, they end with a standard sentence, and considering that not much of value is added, the resource consumption for being this polite may be something which should be avoided.
Maybe adding a "Thank you in advance" to the original prompt would be a compromise. Even better if a TYIA acronym could be learned as a single token.
Actually, this works:
Me: Respond to this: TYIA
GPT3.5: You're welcome! If you have any more questions or need further assistance, feel free to ask.