2 ms·

https://news.ycombinator.com/item?id=35937505 https://news.ycombinator.com/item?id=35937505

• moffkalast 3y ago
  Yeah that's the split layer mode I mentioned. With 6G one can do about 18 layers, which is less than half of the 40 total for 13B.