3 ms·
It's on the model's huggingface README[1]. > For processing 1 million-token sequences: > Qwen2.5-7B-Instruct-1M: At least 120GB VRAM (total across GPUs). > Q
by woadwarrior01 2y ago
It's on the model's huggingface README[1].
> For processing 1 million-token sequences:
> Qwen2.5-7B-Instruct-1M: At least 120GB VRAM (total across GPUs).
> Qwen2.5-14B-Instruct-1M: At least 320GB VRAM (total across GPUs).
[1]: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct-1M https://huggingface.co/Qwen/Qwen2.5-7B-Instruct-1M