3 ms·
Interested in this. Are you thinking of it being a SaaS type thing? I have some rudimentary experience, i.e. training NanoGPT on both Modal.com and Vast.ai (whi
by quickthrower2 3y ago
Interested in this. Are you thinking of it being a SaaS type thing? I have some rudimentary experience, i.e. training NanoGPT on both Modal.com and Vast.ai (which is vastly cheaper, but privacy/cost trade off there).
It could be a layer on top of $gpu_cloud (so end user signs up for the cloud) and the service makes use of those resources.
- senseiV 3y agoDo you inference NanoGPT with say a Flask app? I made a WebUI for tiny Llama, but it doesn't work for NanoChatGPt
- quickthrower2 3y agoHa ha not sure yet, I have only done it from the command line. Still got a lot to learn. Building something like this will be good for that!