What transformer models are you using? How are you training them? Are you using them for semantic search, or only for “transforming“ the output (from a found sn

What transformer models are you using? How are you training them? Are you using them for semantic search, or only for “transforming“ the output (from a found snippet of text to an actual answer sentence)? On what hardware are you running this? With such a large index, and using transformers, I would guess that would be quite expensive, wouldn’t it (GPU, lots of RAM)?