3 ms·

BitNet Implementations: * https://huggingface.co/1bitLLM/bitnet_b1_58-large https://huggingface.co/1bitLLM/bitnet_b1_58-large * https://github.com/Oxen-AI/Bit

by lhl 2y ago

BitNet Implementations: * https://huggingface.co/1bitLLM/bitnet_b1_58-large https://huggingface.co/1bitLLM/bitnet_b1_58-large * https://github.com/Oxen-AI/BitNet-1.58-Instruct https://github.com/Oxen-AI/BitNet-1.58-Instruct * https://github.com/nkotak/1.58BitNet https://github.com/nkotak/1.58BitNet See some followups that has some training advice: https://github.com/microsoft/unilm/tree/master/bitnet https://github.com/microsoft/unilm/tree/master/bitnet