3 ms·
A framework could make the programmer think they are in eager mode, while actually making graphs behind the scenes. The trick is to simply not do any calculati
by londons_explore 3y ago
A framework could make the programmer think they are in eager mode, while actually making graphs behind the scenes.
The trick is to simply not do any calculations till the last possible moment - ie. the time the program tries to convert the finished image to a jpeg. Only at that point do you compile the graph and run the actual computation on the GPU.
You then also cache the graph, so that the compilation step can be avoided if the program tries to do the same computation again with different data.
- brucethemoose2 3y ago... Kinda like torch.compile? That approach is limited though. AITemplate and TVM take a looong time to compile and produce standalone executable files, hence the gains are much larger than torch triton.