3 ms·
Are there any 1-bit LLMs available on GitHub?
by brcmthrowaway 2y ago
Are there any 1-bit LLMs available on GitHub?
- hughesjj 2y agoHeck they have some zero bit llm's https://github.com/kelseyhightower/nocode https://github.com/kelseyhightower/nocode
- lhl 2y agoBitNet Implementations: * https://huggingface.co/1bitLLM/bitnet_b1_58-large https://huggingface.co/1bitLLM/bitnet_b1_58-large * https://github.com/Oxen-AI/BitNet-1.58-Instruct https://github.com/Oxen-AI/BitNet-1.58-Instruct * https://github.com/nkotak/1.58BitNet https://github.com/nkotak/1.58BitNet See some followups that has some training advice: https://github.com/microsoft/unilm/tree/master/bitnet https://github.com/microsoft/unilm/tree/master/bitnet