4 ms·
I do have a local model path (Qwen3-4B) for testing. The tradeoff is simply model quality vs locality, which is why Linggen focuses on controlling retrieval ra
by linggen 10mo ago
I do have a local model path (Qwen3-4B) for testing.
The tradeoff is simply model quality vs locality, which is why Linggen focuses on controlling retrieval rather than claiming zero data ever leaves the device. Using a local LLM is straightforward if that’s the requirement.