2 ms·
Fine-tuning a particular pattern of speech or bias seems self evident. The personality verbiage and focus is incredibly contrived as well. I prefer how this typ
by Siegfre 2y ago
Fine-tuning a particular pattern of speech or bias seems self evident. The personality verbiage and focus is incredibly contrived as well. I prefer how this type of idea was approached by Theia (https://vgel.me/posts/representation-engineering/ https://vgel.me/posts/representation-engineering/) and Anthropic (https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html https://transformer-circuits.pub/2024/scaling-monosemanticit...), in both cases the "personality" piece is just a fun little aside to the fact that you can actively bias the LLM in a way that doesn't require retraining, allows for active adjustment, and is more immutable than just using prompts. Also one other thing, the use case in video games while not untrue seems like overkill, character prompts work really well on their own.