3 ms·
Fine-tuning is expensive and slow compared to prompt engineering, for making changes to a production system. You can develop validate and push a new prompt in
by hiddencost 2y ago
Fine-tuning is expensive and slow compared to prompt engineering, for making changes to a production system.
You can develop validate and push a new prompt in hours.
- WithinReason 2y agoYou need to include the prompt in every query, which makes it very expensive
- GaggiX 2y agoThe prompt is kv-cached, it's precomputed.
- WithinReason 2y agoGood point, but it still increases the compute of all subsequent tokens