4 ms·No, I could only get 2.7B to run on 8GB VRam unfortunatly.by RHab 3y agoNo, I could only get 2.7B to run on 8GB VRam unfortunatly.amasad 3y agoit is 2.7Btarruda 3y agoLoading seems to have worked on my laptop's RTX 3070, `nvidia-smi` shows `5188MiB / 8192MiB` in memory usage.