It would be interesting to see if there are any meta reports on people doing research on the topic of resource constrained AI. Has anyone explored whether or no

It would be interesting to see if there are any meta reports on people doing research on the topic of resource constrained AI. Has anyone explored whether or not an AI can improve on its own algorithm while being heavily resource constrained? Is the ability to use less resources a limit of our current hardware? Do we see the current hardware performance improvement trajectory being able to reduce the amount of resources an AI consumes to perform a task? Are our algorithms simply not tuned well for using smaller resources? Could we build better algorithms around resource deficient environments?