12 ms·Show HN: 60% higher tokens per second for 70B custom LLMs1 points by mikejulietbravo 2y agoWe optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost