Just set the required/requested gpu number to 0 and k8s will let you use same gpu with multiple pods. You'll need to make sure to not overload gpu mem, otherwi

Just set the required/requested gpu number to 0 and k8s will let you use same gpu with multiple pods. You'll need to make sure to not overload gpu mem, otherwise you'll get oom errors. You can use k8s patch functionality to add custom resources, essentially use that to represent gpu mem and include the amount of gpu the pod uses in its definition, that way you don't go over the limit.