2 ms·
I didn't think about GPU size. So they don't run this small model on B200s or something?
by pmdr 1mo ago
I didn't think about GPU size. So they don't run this small model on B200s or something?
- nicce 1mo agoThis is open model intended for local usage. So, it doesn't matter. If the end user wants to run this on their own hardware, cost is defined by the electricity price + the price of the processing power. Providers can increase the price as long as the users don't switch for buying the hardware themselves instead.