4 ms·

Abnormally large. I don't see the cost/performance numbers going well for this one.

• tosh 2y ago
  It is both cost efficient in training (+ future fine-tuning) as well as inference compared to most other current models. Can you elaborate?
  • ru552 2y ago
    the unquantized model is almost 1tb in size and the benchmarks provided by Snowflake shows performance in the middle of the pack compared to other recent releases.
  • rajhans 2y ago
    We have published some insights here. https://medium.com/snowflake/snowflake-arctic-cookbook-series-exploring-mixture-of-experts-moe-c7d6b8f14d16 https://medium.com/snowflake/snowflake-arctic-cookbook-serie...