I hope we'll see better inference solutions soon. Instead of installing some version of pytorch and downloading .pt-files I'd like to have an inference engine o

I hope we'll see better inference solutions soon. Instead of installing some version of pytorch and downloading .pt-files I'd like to have an inference engine optimized for my computer, and be able to download trained models that run on multiple different systems. There's already DirectML on Windows, CoreML for Apple, ONNX runtime, etc. Not everyone need to train models, and maybe some fine tuning for things like Dreambooth can even be done on CPU. I think what's holding this back is lack of interest from the academics publishing the models, which is understandable. With a better inference standard option hopefully it would run on AMD too. But I also hope AMD gets their compute to a better place, preferable using open standards so we don't need "Nvidia code", "AMD code", etc.