Neat. I'm interested in doing something similar, but involving PHI, so ChatGPT is out of the question. How would one self-host a LLM without a Web Scale™ GPU fa

Neat. I'm interested in doing something similar, but involving PHI, so ChatGPT is out of the question. How would one self-host a LLM without a Web Scale™ GPU farm? Is FlexGen (recently featured on HN) the way?