3 ms·

Will these smaller on device models lead to a crash in GPU prices?

• htrp 2y ago
  X to doubt.
• sooheon 2y ago
  Prices fall when supply outpaces demand -- this is adding more demand.
  • wmf 2y ago
    This isn't adding GPU demand.
    • sooheon 2y ago
      It adds *PU demand, don't they come out of the same limited number of foundries?
• jondwillis 2y ago
  Not in the short-to-medium-term. Try the local models out, they fall over pretty quickly, even if you have 64GB+ of VRAM.
  • wkat4242 2y ago
    It depends what you use them for. If you ask it for knowledge, like a comparison of vacuum cleaner models then yes, it's a hallucination fest. They just don't have the parameters for this level of detail. This is where ChatGPT is really king. But if you give them the data they need with RAG, they're not bad. Acting on commands, looking stuff up in provided context, summarising all perform pretty well. Which seems to be also what Apple is targeting to do with them.