The answer to your question depends on whether you think LLMs will remain the state-of-the art solution in the domains you are interested over the next few year

The answer to your question depends on whether you think LLMs will remain the state-of-the art solution in the domains you are interested over the next few years/decades/timescale you care about.