The hard part will be figuring out your different categories to classify. As some have pointed out, embedding your documents using an LLM would be a good bet.

The hard part will be figuring out your different categories to classify. As some have pointed out, embedding your documents using an LLM would be a good bet. If you take the time to manually annotate a portion of your data, you could then fine tune a model. You could also try doing some few shot / zero shot with chat GPT. You could also try to do some clustering on your embeddings to see if categories emerge and try to attribute them afterwards