4 ms·Unfortunately, neither VLLM nor TGI support FP8 on AMD yet. But once they do, we will look into it.by cheptsov 2y agoUnfortunately, neither VLLM nor TGI support FP8 on AMD yet. But once they do, we will look into it.