I use CUDA, not MPS, thus my comments about HuggingFace TGI [1]. GPT2 is supported by transformers, but I would expect only a 1.5x speedup [2] in fine-tune by u

I use CUDA, not MPS, thus my comments about HuggingFace TGI [1]. GPT2 is supported by transformers, but I would expect only a 1.5x speedup [2] in fine-tune by using its GPU instead of CPU. [1] https://huggingface.co/docs/text-generation-inference/en/supported_models#supported-models https://huggingface.co/docs/text-generation-inference/en/sup... [2] https://github.com/Ankur3107/transformers-on-macbook-m1-gpu https://github.com/Ankur3107/transformers-on-macbook-m1-gpu