3 ms·
Thank you, that looks useful! I don’t have much RAM on either of my Macs (I usually use Colab or Lambda Labs GPS VPSs to run LLMs). It would be great to add a c
by mark_l_watson 3y ago
Thank you, that looks useful! I don’t have much RAM on either of my Macs (I usually use Colab or Lambda Labs GPS VPSs to run LLMs). It would be great to add a column on your model display for RAM size to run the models.
- jmorgan 3y agoThat's a great idea! Will do. Generally, a 7B model requires at least a Mac with 16GB of shared memory. In practice I see it using about 6GB of RAM when loaded.