About a year ago I used a 70b llama 2 fine tune for financial data to play a game of jeopardy to generate training data for a Bert model used in an rag. It work

About a year ago I used a 70b llama 2 fine tune for financial data to play a game of jeopardy to generate training data for a Bert model used in an rag. It worked better than state of the art at the time. This may seem frivolous but it's amazingly useful for synthetic data.