Hardware acceleration in this case is to draw less power doing day-to-day operations and not melt the user's hand. In the general case most effective hardware

Hardware acceleration in this case is to draw less power doing day-to-day operations and not melt the user's hand. In the general case most effective hardware acceleration uses are supposed to increase latency. Let's take another example for the analogy: you can run your LLM straight in the CPU and it will have awesome latency and very poor throughput; or you can take your sweet time to load the weights into your GPU/NPU/TPU/memory-in-compute device and run it hardware accelerated at lower energy cost and higher throughput.