3 ms·
taco's runtime appears to be designed for large sparse data while we designed Tile specifically for the dense linear algebra operations in neural nets. Quite a
by hedgehog 9y ago
taco's runtime appears to be designed for large sparse data while we designed Tile specifically for the dense linear algebra operations in neural nets. Quite a bit of work has gone into making the Tile runtime do the necessary optimizations to make neural nets run efficiently on GPUs and other accelerator designs, none at all for sparse workloads. Given that I'd expect the internals to be fairly different.
- FiveDegrees 9y agoHave you benchmarked Tile against Stalin∇? https://github.com/Functional-AutoDiff/STALINGRAD https://github.com/Functional-AutoDiff/STALINGRAD Page 3: http://barak.pearlmutter.net/papers/ad2016b.pdf http://barak.pearlmutter.net/papers/ad2016b.pdf
- hedgehog 9y agoThat looks both clever and interesting, do you know if they have published any benchmarks on GPU or other accelerator targets?
- FiveDegrees 9y agoNot that I've been able to find.
- Isinlor 9y agoWho in his right mind would name a library after Stalin?!
- laingc 9y agoIt’s a word play on “Stalingrad”. It’s kind of funny.
- Isinlor 9y agoIf I would name a library after a man who directly ordered to kill your grandparents and grandparents of your colleagues by shooting them in back of their head would you find it funny? https://en.wikipedia.org/wiki/Katyn_massacre https://en.wikipedia.org/wiki/Katyn_massacre The man who sent an army to kill and rape people in your country? https://en.wikipedia.org/wiki/Soviet_invasion_of_Poland https://en.wikipedia.org/wiki/Soviet_invasion_of_Poland The man who planned to crash a nation by starving it? https://en.wikipedia.org/wiki/Holodomor https://en.wikipedia.org/wiki/Holodomor You know, people from your history lessons actually lived like you and I do and some of them still do, as do their families.
- FiveDegrees 9y agoYou are of course entirely right. It may be worthwhile to email Siskind or Pearlmutter on the subject. I believe Siskind has a tradition of naming things after brutal dictators, so I imagine it's liable to not amount to much. Might as well name your VR SDK Holodomor.
- laingc 9y agoYou’ve run away with this a bit too far. Firstly, I am staunchly anti-Stalinist, anti-communist, and anti-socialist. I’ve been to former Soviet states and seen the devastation that Stalin and his ilk wrought. Secondly, the library is a wordplay on the name of the city (or perhaps the well-known battle) of Stalingrad. That’s already a step removed from being named after Stalin. Thirdly, stop trying to turn the world into a humourless wasteland. The policing of jokes of questionable taste screams of moral panic.
- singularity2001 9y agoalmost as funny as naming a catacomb 'Hit Lair'