3 ms·
Deploy dedicated DeepSeek 32B on L40 GPUs ($8/hour)
- neilbhatt 2y agonice, i can actually use my AWS start up creds
- tchaton84 2y agoDoes it support largest Deepseek model ?
- yewnork 2y agocurious the performance / price tradeoffs between deepseek-r1 671b, 70b, 32b
- lmilad 2y agoHow well does DeepSeek R1 handle generating long pieces of text with Qwen 32B?
- ashenWon 2y agoIs this running ollama, vllm or sglang under the hood? Curious about these performance numbers.
- woodr77 2y agoEveryone's saying I needed H100s for this. L40 is way easier for me to get my hands on. great news.