3 ms·
The current deepseek-coder version (v2) is actually a fine tune off of the deepseek v2 model, and was not trained from scratch. I’m now getting conflicting inf
by darksaints 2y ago
The current deepseek-coder version (v2) is actually a fine tune off of the deepseek v2 model, and was not trained from scratch.
I’m now getting conflicting information about the origin of the deepseek MOE framework, so I may be wrong about it starting with a Mixtral model.