2 ms·You'd need high usage density to justify investing on a GPU just to run a 70b model locally.by rmbyrro 3y agoYou'd need high usage density to justify investing on a GPU just to run a 70b model locally.