Do the basics from page speed index and you will be fine. Most personal websites will be static sites. Just make it hit 100 in all the four categories. Or use a

Do the basics from page speed index and you will be fine. Most personal websites will be static sites. Just make it hit 100 in all the four categories. Or use a theme which does that for your SSG. It's not that hard. And most importantly, don't try to swim against the tide. Leave it as it is. My website does pretty OK. And another important thing, don't worry about google ranking. There is nothing you can do about it. Create as much organic traffic as possible. Leave out all the rest.