3 ms·
GPT-3.5/GPT-4 ain't the only LLMs available. A Flan-T5/T5 or Llama2/3 8B models may be finetuning for this use case and used for much cheaper.
by mrbungie 2y ago
GPT-3.5/GPT-4 ain't the only LLMs available. A Flan-T5/T5 or Llama2/3 8B models may be finetuning for this use case and used for much cheaper.
- spaniard89277 2y agoHow do you handle the context window limit? If you push the entire Dom to the LLM it will exceed the context window by far in most cases, isn't it?
- aleksiy123 2y agoMy guess is you do some preprocessing on the DOM to get it down to text but still retains some structure. Something like https://github.com/Alir3z4/html2text https://github.com/Alir3z4/html2text. I'm sure there are other (better?) options as well.
- tarasglek 2y agoI wrote https://markdown.download https://markdown.download as a general helper for this
- msp26 2y agoTrim unwanted html elements + convert to markdown. Significantly reduces token counts while retaining structure.