4 ms·
The new transformers release describes the model: https://github.com/huggingface/transformers/releases/tag/v4.55.0 https://github.com/huggingface/transformers/r
by minimaxir 1y ago
The new transformers release describes the model: https://github.com/huggingface/transformers/releases/tag/v4.55.0 https://github.com/huggingface/transformers/releases/tag/v4....
> GPT OSS is a hugely anticipated open-weights release by OpenAI, designed for powerful reasoning, agentic tasks, and versatile developer use cases. It comprises two models: a big one with 117B parameters (gpt-oss-120b), and a smaller one with 21B parameters (gpt-oss-20b). Both are mixture-of-experts (MoEs) and use a 4-bit quantization scheme (MXFP4), enabling fast inference (thanks to fewer active parameters, see details below) while keeping resource usage low. The large model fits on a single H100 GPU, while the small one runs within 16GB of memory and is perfect for consumer hardware and on-device applications.