4 ms·

I don't see any code in there. What runtime could load these weights?

• brucethemoose2 3y ago
  Its presumably llama just like Mistral. Everything open source is llama now. Facebook all but standardized the architecture. I dunno about the moe. Is there existing transformers code for that part? It kinda looks like there is based on the config.
  • jasonjmcghee 3y ago
    Mistral is not llama architecture. https://github.com/mistralai/mistral-src https://github.com/mistralai/mistral-src
    • brucethemoose2 3y ago
      Its basically llama architecture, all but drop in compatible with llama runtimes.
  • refulgentis 3y ago
    Because it's JSON? :)