4 ms·

LoRA doesn’t change the context length. Also you can’t run LoRAs on GPT-4. So those are not relevant to each other.

• jurdjir 3y ago
  The distinction becomes less meaningful if you can hold large numbers of tokens in attention, doesn’t it?
  • sp332 3y ago
    I don't... think so. One of us is very confused.