5 ms·
There are some pretty elegant solutions out there for the problem of having the right ratio of CPU to GPU. One of the nicer ones is rCUDA. https://scholar.googl
by fancyfredbot 4y ago
There are some pretty elegant solutions out there for the problem of having the right ratio of CPU to GPU. One of the nicer ones is rCUDA. https://scholar.google.com/citations?view_op=view_citation&hl=es&user=4XgrRlMAAAAJ&citation_for_view=4XgrRlMAAAAJ:zYLM7Y9cAGgC https://scholar.google.com/citations?view_op=view_citation&h...
- varunkmohan 4y agorCUDA is super cool! One of the issues though is for a lot of the common model frameworks are not supported and a new release has not come out a while.
- fancyfredbot 4y agoFair point. It's not obvious from the website which model frameworks does exafunction supports, or when the last exafunction release was.
- varunkmohan 4y agoYeah, we should have a public release very soon for people to deploy internally. We will have support for all the commonly-used frameworks and different versions.
- fancyfredbot 4y agoSounds awesome, look forward to it.