3 ms·
wait, why is embedding the graph into the file bad? it enables really clean separation of the core autodiff library and whatever backend you want to use to acc
by taminka 3y ago
wait, why is embedding the graph into the file bad?
it enables really clean separation of the core autodiff library and whatever backend you want to use to accelerate the graph computations, which can simply read the file and be completely independent of the core implementation
but also, if you just store the tensors in some arbitrary order and then store the indices of the order in which they have to read and traversed, you can easily adjust the graph to add stuff like layer fusion or smth similar (i'm not really familiar w/ comp graph optimisations tbh)
what would an alternative look like anyway?