Like you, I'm similarly situated -- and I'll probably take a few months (to a year) break from following this stuff too closely (e.g. trying to get these runnin

Like you, I'm similarly situated -- and I'll probably take a few months (to a year) break from following this stuff too closely (e.g. trying to get these running locally on my own). I have a suspicion that things will be a bit more lightweight and/or optimized by then, and it'll be way more tractable+economical to play with and selfhost many of these models.