Some people will have the necessary hardware, others will be able to run it in the cloud. I'm curious how they will get these LLM to work with consumer hardwar

Some people will have the necessary hardware, others will be able to run it in the cloud. I'm curious how they will get these LLM to work with consumer hardware myself. Is FP8 is the way to get them small?