2 ms·
Any guesses as to why they bumped the parameter count up from 7B to 8B?
by miven 3y ago
Any guesses as to why they bumped the parameter count up from 7B to 8B?
- matrix2596 3y agoI also wondered the same and check the model configs. they are using bigger vocab size and the intermediate size of fully connected layer seems to be bigger.