evolve7942

3 ms·

1. 1.▲
   by evolve7942 2y ago

   > I know multiple startups that use LLMs as their core bread-and-butter intelligence platform instead of tuned but traditional NLP models It seems like LLMs would be perfect for start-ups that are iterating quickly. As the business, pro
2. 2.▲
   by evolve7942 3y ago

   GPU RAM quantity isn’t typically correlated to inference rate. Precision/quantization levels do affect model size, which will affect inference rate. However, I would expect a smaller model to be faster (less RAM).
3. 3.▲
   by evolve7942 3y ago

   If you think this is wild, see the PaLM 2 paper with 2.5 pages of 2 column attributions. https://arxiv.org/pdf/2305.10403.pdf
4. 4.▲
   by evolve7942 4y ago

   I’d be wary of this decision since now you’ve elected to just work with the insurance salesperson, whose goal is to spend as little as possible on you. Providers at KP regularly tell you to “advocate for yourself” because now the doctors ar