5 ms·
To train GANs you need access to the internal states of the generator, which you wouldn't have with these LLMs.
by WithinReason 4y ago
To train GANs you need access to the internal states of the generator, which you wouldn't have with these LLMs.
- KRAKRISMOTT 4y agoYou don't need the internal state if you have effectively unlimited API calls querying the generator endpoint. Your loss function can be with respect to the adversarial network only.
- WithinReason 4y agoThen you need an effectively unlimited number of queries to train you network, while the LLM can be trained on a few samples your network produces to counter it.
- KRAKRISMOTT 4y agoWdym? The LLM doesn't have access to your internal state either. Nobody's at an advantage here in a zero sum configuration.
- WithinReason 4y agoJust read what I wrote again.
- KRAKRISMOTT 4y agoYou need to explain your thoughts better.