4 ms·
> his contributions included investigating why generative AI systems suck up to users Why does it take research to figure this out? Possibly the greatest unspo
by CrimsonCape 8mo ago
> his contributions included investigating why generative AI systems suck up to users
Why does it take research to figure this out? Possibly the greatest unspoken problem with big-coporate-AI is that we can't run prompts without the input already pre-poisoned by the house-prompt.
We can't lead the LLM into emergent territory when the chatbot is pre-engineered to be the human equivalent of a McDonalds order menu.
- Mentlo 8mo agoI find your belief that what is needed for emergence is better prompting … amusing. The ai would still be sycophantic even without the pre-prompt. It’s been reinforced to do so, it’s baked in the weights.