4 ms·
Same! The only reason I'm not using it more is because it's summertime. I'm not in any hurry. Setting the memory to "fast timings" is good for 8-12% more token
by monster_truck 3mo ago
Same! The only reason I'm not using it more is because it's summertime. I'm not in any hurry.
Setting the memory to "fast timings" is good for 8-12% more tokens/second if you haven't tried yet. I miss the slightly older days of AMD when powerplay tables were unlocked and we could configure the timings and voltages manually, there's another 30% being left on the table ez
- MrDrMcCoy 3mo agoWhat do you mean by 'Setting the memory to "fast timings"'? The only runtime I can get working for my GPUs is llama.cpp, which I haven't seen anything like that in its argument set. My perusal of the options for vllm and sglang didn't suggest anything similar either before failing miserably.
- sonic45132 3mo agoI think they are referring to the AMD drivers on windows, under the overclocking section you can enable fast memory timings. Not sure if this sort of thing is exposed on linux.
- monster_truck 2mo agoYou can edit sys files or use amdmemorytweak on linux.