4 ms·

Grok Weights Available via Torrent

• kaliqt 3y ago
  They made good on their promise it would seem.
• deleted 3y ago
  [deleted]
• sp332 3y ago
  Bold to make a joke about the tsunami of spam overrunning the site.
• rvz 3y ago
  As promised, weights are available. For those who don't like Twitter / X, Here are the details from the README: - 314B parameter Mixture of Experts model - Base model (not finetuned) - 8 experts (2 active) - 86B active parameters - Apache 2.0 license - Code: https://github.com/xai-org/grok https://github.com/xai-org/grok - Weights: https://github.com/xai-org/grok?tab=readme-ov-file#downloading-the-weights https://github.com/xai-org/grok?tab=readme-ov-file#downloadi... Even more open than OpenAI.
  • permalac 3y ago
    How many H100 does one need to run this?
  • permalac 3y ago
    How many H100 does one need to run this?
    • sp332 3y ago
      8.
• ronsor 3y ago
  It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.
  • ls612 3y ago
    So this isn't something anyone without H100s is ever running no matter how you quantize it.
• deleted 3y ago
  [deleted]
• ChrisArchitect 3y ago
  Some more discussion: https://news.ycombinator.com/item?id=39737281 https://news.ycombinator.com/item?id=39737281