You either can assure you have enough processing power to stay within cycle budgets, or prioritize objects or whatever and try to process the n most meaningful

You either can assure you have enough processing power to stay within cycle budgets, or prioritize objects or whatever and try to process the n most meaningful ones. Getting these priorities wrong can get you into trouble. But at least the framerate is ok =;-). This is normal business in realtime systems.