3 ms·
you know what i still don't understand? what's taking so long to warm up? i see that there are graph passes that run to do various things at the TS IR level, bu
by tubby12345 5y ago
you know what i still don't understand? what's taking so long to warm up? i see that there are graph passes that run to do various things at the TS IR level, but I don't see any stats being collected (on shapes) or something like that that then inform further optimization.
- bertr4nd 5y agoThere’s a “profiling graph executor” that records shapes and then hands them off to a fusion compiler. The profiling executor re-specializes on every new shape it sees, but stops at 20 re-specialization. We’re working on eliminating the dependence on shape specialization right now, since it’s kind of an unfortunate limitation for some workloads.