3 ms·
The source used to create the model is here: https://github.com/mistralai/mistral-src/blob/main/mistral/model.py https://github.com/mistralai/mistral-src/blob/m
by HanClinto 3y ago
The source used to create the model is here:
https://github.com/mistralai/mistral-src/blob/main/mistral/model.py https://github.com/mistralai/mistral-src/blob/main/mistral/m...
The source used to train information into the model is elsewhere.
You have the engine. You don't have the source of the data.
- monocasa 3y agoThat's the inference source as stated in the readme > This repository contains minimal code to run our 7B model
- HanClinto 3y agoThe code I linked is the model source -- the structural skeleton. You can create a model with this source and put whatever weights you want in it -- just like Doom.
- monocasa 3y agoThat is some source. That is not the source behind what built the 14GB model.
- HanClinto 3y agoIf you create a model with this code and save it to disk, it will indeed be 14GB. It will be random weights -- the contents won't be there -- but it will be 14GB. If you use only what is open-source about Doom, you will have an unplayable game. If you use only what is open-source about Mistral, you will have an ineffective model. It's not nothing.
- monocasa 3y agoThe claim is that the complete model, including the weights, is open source. Doom explicitly doesn't cover it's assets as open source.