There are some recent foundation models pre-trained on time-series data. For example TimesFM from Google. Of course, it's not directly built for classification,

There are some recent foundation models pre-trained on time-series data. For example TimesFM from Google. Of course, it's not directly built for classification, and it's meant for univariate datasets, so it would take some work to adapt it to these problem domains.