Upscaling NNs already exist, but that's beside the point. This is a demonstration that no domain-specific knowledge needs to be encoded in your architecture. Ma

Upscaling NNs already exist, but that's beside the point. This is a demonstration that no domain-specific knowledge needs to be encoded in your architecture. Manually wiring different NNs together to split a task into separate subtasks would be the opposite. Far more interesting would be general training optimizations that could train GPT faster on any kind of task.