That time is just for the very first prompt. It is basically the startup time for the model. Once it is loaded, it is much much faster in responding to your que

That time is just for the very first prompt. It is basically the startup time for the model. Once it is loaded, it is much much faster in responding to your queries. Depending on your hardware of course.