2 ms·
yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone ap
by FezzikTheGiant 2y ago
yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone app. For ex. a game
- jaggs 2y agoOh sorry. Hm..I actually have no idea. It sounds like a neat idea though. :)