2 ms·

If a typical LLM has decent representation of the languages in question (and you'd be surprised how little decent is with all the positive transfer that goes on

If a typical LLM has decent representation of the languages in question (and you'd be surprised how little decent is with all the positive transfer that goes on during training) then outsourcing translation is just a downgrade. a pretty big one in fact. https://github.com/ogkalu2/Human-parity-on-machine-translations https://github.com/ogkalu2/Human-parity-on-machine-translati... T5 seems to be the default so i get why it's done here. Just an observation.

senko 4y ago
Outsourcing everything but the reasoning process helps with preventing prompt injection attacks: https://simonwillison.net/2023/Apr/25/dual-llm-pattern/ https://simonwillison.net/2023/Apr/25/dual-llm-pattern/ Even if you're outsourcing to a restricted instance of the same model, it could be beneficial.