2 ms·
Do you think you'll switch to running local models at some point e.g. LambdaLabs/Runpod running Llama to reduce costs? Just thinking about as you scale and want
by mmaunder 2y ago
Do you think you'll switch to running local models at some point e.g. LambdaLabs/Runpod running Llama to reduce costs? Just thinking about as you scale and wanting to reduce cost per token. (I'm not in the GPU hosting biz - just curious because I think we're all thinking about this)