Perhaps it could just try and learn the parameters to some kind of pre existing control theory algorithm? Perhaps with a simulator it could fall into the first

Perhaps it could just try and learn the parameters to some kind of pre existing control theory algorithm? Perhaps with a simulator it could fall into the first category you mentioned.