Thanks for the very in detail explaination, great help! It's insane to think we can run a 175B parameter model on a consumer card (with enough time). Will def.

Thanks for the very in detail explaination, great help! It's insane to think we can run a 175B parameter model on a consumer card (with enough time). Will def. look into "offline execution engine" type of use cases, though with more than 8GB of VRAM