4 ms·
How are you running Falcon? ggllm.cpp is really slow at tokenizing the input, so it doesn't work for large context.
by VadimPR 3y ago
How are you running Falcon? ggllm.cpp is really slow at tokenizing the input, so it doesn't work for large context.