Not the person you're asking, but - Long iteration time kills productivity, a lot of AI work has long iteration time because hardware is slow. - It's possible

Not the person you're asking, but - Long iteration time kills productivity, a lot of AI work has long iteration time because hardware is slow. - It's possible that bigger models on faster hardware are actually all we need to solve some problems. For example see GPT-3.