Currently >8 token/s; there is a demo in this post: https://www.linkedin.com/posts/jasondai_run-671b-deepseek-r1-q4km-model-from-unsloth-activity-73031941827292

Currently >8 token/s; there is a demo in this post: https://www.linkedin.com/posts/jasondai_run-671b-deepseek-r1-q4km-model-from-unsloth-activity-7303194182729244673-l8Ut https://www.linkedin.com/posts/jasondai_run-671b-deepseek-r1...