Yes but we are waiting fro the release of the right hardware to enable local inference efficiently. These times are confused because all the available solution

Yes but we are waiting fro the release of the right hardware to enable local inference efficiently. These times are confused because all the available solutions are suboptimal for NN inference in the consumer market.