3 ms·
I think some of your points are myopic — the same thing was said for language models, but RLHF and RLAF [0] clearly show a trajectory of the models getting bett
by alextheparrot 4y ago
I think some of your points are myopic — the same thing was said for language models, but RLHF and RLAF [0] clearly show a trajectory of the models getting better at doing this self-improvement process with less “humans are special”ness.
A tool like Copilot can more or less automatically improve via telemetry, I’d expect the same thing as image models catch-up. I’d also expect the human signals to get further and further downstream of the actual creation process (e.g. Gameplay tester reports visual bug versus artist manually edits character)
[0] https://www.anthropic.com/constitutional.pdf https://www.anthropic.com/constitutional.pdf
- otabdeveloper4 4y agoThis only works if you ignore intellectual property laws, which isn't gonna happen once AI leaves the "research lab" phase and becomes a commercial industry.
- alextheparrot 4y agoThis comment confuses me a bit, as AI improving via feedback on its generations introduces no new concerns. Which new intellectual property concerns are introduced via reinforcement learning? An aside, but people use and pay for Copilot, it is out of the research lab phase.
- otabdeveloper4 4y agoFirst thing you'll want is for AI to generate a) stuff in new genres and b) proprietary stuff (Marvel Cinematic Universe, Nintendo, etc.) None of this is solved algorithmically.