3 ms·
Sounds like an extremely complex technical problem. I also suggest to look at the use cases when this is needed. One of the problems is that loading weights int
by cheptsov 2y ago
Sounds like an extremely complex technical problem. I also suggest to look at the use cases when this is needed. One of the problems is that loading weights into the GPU will be so slow that it will be really hard to share the GPU between different processes - causing long time to offload and load. Would love to learn more about what you do.
- cpeterson42 2y agoTotally right on all fronts. This has been tough to build and we are still searching for the best use cases. If you are down to chat my email is in my profile, any insights would help us a ton!
- cpeterson42 2y agoHi Cheptsov, know you mentioned wanting to learn more. We have some demo material that we can share if you're interested. Would love to chat at carl (at) thundercompute (dot) com.