3 ms·

Good choice on the 24 GB Titan RTX (so you can do at least batch size = 1 for Bert-Large). Not sure if that's the reason it was chosen though to be honest. If y

Good choice on the 24 GB Titan RTX (so you can do at least batch size = 1 for Bert-Large). Not sure if that's the reason it was chosen though to be honest. If you want to do convnets only then you would do better with NVLinke'd 2080 Tis. Secondarily, I would suggest that you guys not use windows but instead Ubuntu 18.04 or 20.04 LTS and just install Lambda Stack (https://lambdalabs.com/lambda-stack-deep-learning-software https://lambdalabs.com/lambda-stack-deep-learning-software). It's a debian PPA that we maintain at Lambda to keep all of your deep learning drivers, CUDA, CuDNN, TensorFlow, and PyTorch up to date with just apt. It's free!

mastazi 6y ago
Interesting! Is Lambda Stack going to work on 20.04? The link mentions only 16.04 and 18.04
- hughdbrown 6y ago
  I've asked Lambda Labs 2-3 times if they are going to do an Ubuntu 20.04 stack, but I have not had a reply yet.
  - sabalaba 6y ago
    It works for 20.04. Sorry if you didn’t get a reply, I’ll look into it. Where did you email us?
  - sabalaba 6y ago
    It works for 20.04 LTS and we've updated the website to reflect this, thanks for bringing it to my attention!
mushufasa 6y ago
how does that compare to the pop_os! nvidia drivers, default on their downstream-from-ubuntu distro?
- proverbialbunny 6y ago
  It's a bit more straightforward on Pop OS with two lines, `sudo apt install system76-cuda-latest ;; sudo apt install system76-cudnn-10.2`
icelancer 6y ago
Been very happy with Lambda Stack at our company!