3 ms·
I am curious to know what you are doing that is AVX heavy, but doesn't benefit from more cores? The first thing that came to my mind is llama.cpp, but its actu
by brucethemoose2 3y ago
I am curious to know what you are doing that is AVX heavy, but doesn't benefit from more cores?
The first thing that came to my mind is llama.cpp, but its actually core count bound for prompt ingestion and mostly RAM speed bound during token generation.