3 ms·You don't need a big one, even an old 4GB GPU will massively accelerate the prompt ingestion.by brucethemoose2 3y agoYou don't need a big one, even an old 4GB GPU will massively accelerate the prompt ingestion.