4 ms·
Quick question: what would you estimate the running cost of Llama 2 70b to be? (On GPU, and assuming maximum utilization)?
by npsomaratna 3y ago
Quick question: what would you estimate the running cost of Llama 2 70b to be? (On GPU, and assuming maximum utilization)?
- cpill 3y agoyeah, that's the real question here