4 ms·
Yes, I agree that there is a market for this. But I am not part of that market - I really want more beefy cores with lots of AVX units (I'm perfectly content if
by gautamcgoel 3y ago
Yes, I agree that there is a market for this. But I am not part of that market - I really want more beefy cores with lots of AVX units (I'm perfectly content if these beefy cores have low base clocks to conserve power).
- brucethemoose2 3y agoI am curious to know what you are doing that is AVX heavy, but doesn't benefit from more cores? The first thing that came to my mind is llama.cpp, but its actually core count bound for prompt ingestion and mostly RAM speed bound during token generation.