3 ms·

I am business prof. I wanted my students to try out ollama (with web-ui), so I built some directions for doing so on google cloud [1]. If you use a spot instanc

by mrtimo 3y ago

I am business prof. I wanted my students to try out ollama (with web-ui), so I built some directions for doing so on google cloud [1]. If you use a spot instance you can run it for 18 cents an hour. [1] https://docs.google.com/document/d/1OpZl4P3d0WKH9XtErUZib5_2EA_QTy50YjJM0kjX1g4/edit https://docs.google.com/document/d/1OpZl4P3d0WKH9XtErUZib5_2...

teruakohatu 3y ago
Very useful thanks
ijustlovemath 3y ago
The way you've set this up, your students could be too late to claim admin and have their instance hijacked. Very insecure. Would highly recommend you make them use an SSH key from git-bash; it's no more technical than anything you already have.
dizhn 3y ago
You can run a lot of things on Google Colab for free as well. KoboldCPP has a nice premade thing on their website that can even load different models.