4 ms·
At first glance this looks very similar to just adding the contrastive prompts to the beginning of the system prompt to "prepare" the logits. What am I missing?
by rgbrgb 3y ago
At first glance this looks very similar to just adding the contrastive prompts to the beginning of the system prompt to "prepare" the logits. What am I missing?
- gsuuon 3y agoI guess since the control vectors are applied at every layer, it becomes impossible to override (e.g. if you're consuming user-generated prompts)