3 ms·
I'd rather see someone implemented glue that allows you to run arbitrary (deep learning) code on any platform. I mean, are we going to see X on M1 Mac, for any
by amelius 4y ago
I'd rather see someone implemented glue that allows you to run arbitrary (deep learning) code on any platform.
I mean, are we going to see X on M1 Mac, for any X now in the future?
Also, weren't torch and tensorflow supposed to be this glue?
- nathas 4y agoBroadly speaking, it looks like they are. The implementation of Stable Diffusion doesn't appear to be using all of those features correctly (i.e. device selection fails if you don't have CUDA enabled even though MPS (https://pytorch.org/docs/stable/notes/mps.html https://pytorch.org/docs/stable/notes/mps.html) is supported by PyTorch. Similar goes for quirks of Tensorflow that weren't taken advantage of. That's largely the work that is on-going in the OSX and M1 forks.
- davedx 4y agoI got stuck on this roadblock, couldn’t get CUDA to work on my Mac, was very confusing
- desindol 4y agoDidn’t apple stop supporting Nvidia cards like 5 years ago? How could it be confusing that Cuda wouldn’t run?
- root_axis 4y agolol presumably the OP didn't know that... hence the confusion.
- davedx 4y agoAh, I didn't realize. It's not very obvious what GPU you have in your Macbook, I couldn't actually find out where to find that in my System settings. On Windows it's inside the "Display" settings but on MacOS... where is it? :)
- cercatrova 4y agoThat's because CUDA is only for Nvidia GPUs and Apple doesn't support Nvidia GPUs, it has its own now.
- dustingetz 4y ago(base) stable-diffusion git:(main) conda env create -f environment.yaml Collecting package metadata (repodata.json): done Solving environment: failed ResolvePackageNotFound: - cudatoolkit=11.3 oh i was following the github fork readme, there is a special macos blog post
- calrizien 4y agolink?
- scoopertrooper 4y agoIf you look at the substance of the changes being made to support Apple Silicon, they're essentially detecting an M* mac and switching to PyTorch's Metal backend. So, yeah PyTorch is correctly serving as a 'glue'. https://github.com/CompVis/stable-diffusion/commit/0763d366ec53137a43cfd518ea9781f40e8306d1 https://github.com/CompVis/stable-diffusion/commit/0763d366e...
- bfirsh 4y agoAs mentioned in sibling comments, Torch is indeed the glue in this implementation. Other glues are TVM[0] and ONNX[1] These just cover the neural net though, and there is lots of surrounding code and pre-/post-processing that isn't covered by these systems. For models on Replicate, we use Docker, packaged with Cog for this stuff.[2] Unfortunately Docker doesn't run natively on Mac, so if we want to use the Mac's GPU, we can't use Docker. I wish there was a good container system for Mac. Even better if it were something that spanned both Mac and Linux. (Not as far-fetched as it seems... I used to work at Docker and spent a bit of time looking into this...) [0] https://tvm.apache.org/ https://tvm.apache.org/ [1] https://onnx.ai/ https://onnx.ai/ [2] https://github.com/replicate/cog https://github.com/replicate/cog