4 ms·
will give executorch a try. with llamastack, well making it work with CUDA for starters would be great. it is also bloated. something that supposed to take di
by nikolayasdf123 2y ago
will give executorch a try.
with llamastack, well making it work with CUDA for starters would be great.
it is also bloated. something that supposed to take direct 100 lines of code and a couple files, takes dozens of files, multiple frameworks, generators.. which in the end do not work at all, and nobody knows why. very obscure framework. can't believe this code is coming from Meta.