You can tweak the power limit settings for your application. In many cases you can drop the power consumption (and heat generated) while still maintaining > 90%

You can tweak the power limit settings for your application. In many cases you can drop the power consumption (and heat generated) while still maintaining > 90% performance but this will depend on your actual use case [0]. In my experience for many models you can reduce the power limit even further than what has been tested in this guide while barely impacting performance. [0] https://timdettmers.com/2020/09/07/which-gpu-for-deep-learning/#Power_Limiting_An_Elegant_Solution_to_Solve_the_Power_Problem https://timdettmers.com/2020/09/07/which-gpu-for-deep-learni...