3 ms·
> the 12-billion-parameter model is about 24GB in size Probably not on the device itself but I would love that use case as well. At least going to my own serve
by tonygiorgio 2y ago
> the 12-billion-parameter model is about 24GB in size
Probably not on the device itself but I would love that use case as well. At least going to my own server. I’d want to protect notes in particular, which is why I don’t do any cloud backup on my RM2. But some self hosted, AI assisted OCR workflows could be really nice.