3 ms·
For our >350M models, here is an example of how to load these within Colab: https://colab.research.google.com/drive/11YU00W-JLNXn-3YckJGOSxFf_TQfCXYr?usp=shari
by enijkamp 4y ago
For our >350M models, here is an example of how to load these within Colab:
https://colab.research.google.com/drive/11YU00W-JLNXn-3YckJGOSxFf_TQfCXYr?usp=sharing https://colab.research.google.com/drive/11YU00W-JLNXn-3YckJG...
This little hack will force tensor alloc on GPU instead of CPU mem.
- amrrs 4y agoWow this is amazing. Sorry for a dumb question, will it work any such LLMs or only in Codegen's case?