4 ms·
Not OP but for me a big thing is privacy, I can feed it personal documents and expect those to not leak. It has zero cost, hardware is already there. I'm not c
by adriancr 2y ago
Not OP but for me a big thing is privacy, I can feed it personal documents and expect those to not leak.
It has zero cost, hardware is already there. I'm not captive to some remote company.
I can fiddle and integrate with other home sensors / automation as I want.
- hentrep 2y agoCurious as I’m of the same mind - what’s your local AI setup? I’m looking to implement a local system that would ideally accommodate voice chat. I know the answer depends on my use case - mostly searching and analysis of personal documents - but would love to hear how you’ve implemented.
- dgfitz 2y agollama.ccp and time seems to be the general answer to this question.
- adriancr 2y agoIf you are just starting up, you can try out 'open-webui' as inspiration. After that you can just use llama.cpp to build out your own things. Hardware side, I just have a beefy server that acts as a router (mellanox card to provider fiber optic and local fiber network), firewall, wifi access point, zigbee coordinator, host to various services, camera video feed ingestion and processing, and so on...
- red-iron-pine 2y agodefine brefy server