Bitnet 1.58 Implementation

Original Paper

• BitNet: Scaling 1-bit Transformers for Large Language Models
• The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
• The Era of 1-bit LLMs: Training Tips, Code and FAQ

Collaborators

• Puneet Kakkar
• Arush Kumar
• Tanmay Sharma

Acknowledgements

• BitNet
• BitNet Transformers