4 ms·

Agreed. Rag isn't ideal for every scenario. Putting the contents of the menu in the prompt could even be feasible with a smaller model.