SmilingSuccess

3 ms·

1. 1.▲
   by SmilingSuccess 1y ago

   Yes we did, this one is for calculating VRAM/RAM usage as well, to compliment Kolosal CLI and Desktop app and as a quick and easy tool to check if a model would run on your device
2. 2.▲
   I build a tools to calculate how much VRAM is needed to run LLMs(kolosal.ai)

   3 points by SmilingSuccess 1y ago|3 comments
3. 3.▲
   by SmilingSuccess 1y ago

   I built a simple tool to estimate how much memory is needed to run GGUF models locally, based on your desired maximum context size. You just paste the direct download URL of a GGUF model (for example, from Hugging Face), enter the context l