4 ms·
> "Frontier LLMs can do it with enough context" is not really a strong argument against fine-tuning, because they're expensive to run. I am not expert in this
by andriy_koval 8mo ago
> "Frontier LLMs can do it with enough context" is not really a strong argument against fine-tuning, because they're expensive to run.
I am not expert in this topic, but I am wondering if large cached context is actually cheap to run and frontier models would be cost efficient too in such setting?
- prettyblocks 8mo agoI'd like to read more about that if anyone has any suggestions.
- andriy_koval 8mo agoI am not expert in this topic, but its easy to observe that price for cached tokens is usually 10x cheaper on major providers.