5 ms·
How much RAM browser wants to run LLM local processing?
by glintik 3y ago
How much RAM browser wants to run LLM local processing?
- skeeter2020 3y agoprobably less than it needs for a few dozen open tabs based on my past profiling experiences...
- kevindamm 3y agoHow long are you willing to wait?
- dchest 3y agoUsually around 5 GB for a 7B 4-bit quantized model.