3 ms·
$make run -j 10 CUDA error in attention.c:91: out of memory Command exited with non-zero status 1 1.38user 0.46system 0:00.75elapsed 246%CPU (0avgtext+0avgda
by qqqqqlqq 4mo ago
$make run -j 10
CUDA error in attention.c:91: out of memory
Command exited with non-zero status 1
1.38user 0.46system 0:00.75elapsed 246%CPU (0avgtext+0avgdata 226164maxresident)k
0inputs+0outputs (0major+25414minor)pagefaults 0swaps
make: ** [Makefile:34: run] Błąd 1
clang: warning: CUDA version 12.4 is only partially supported [-Wunknown-cuda-version]
(I have ubuntu and 8GB memory
NVIDIA GeForce RTX 3050 876MiB / 8192MiB )
- markusheimerl 4mo agoReduce batch size in train.c
- ewew53 4mo agohow to do this? I have this same error
- markusheimerl 4mo agohttps://github.com/markusheimerl/gpt/blob/main/train.c https://github.com/markusheimerl/gpt/blob/main/train.c - in this file, search for the line "const int batch_size = 15;" - reduce this number