4 ms·
Same prompt. Same code. Different output weeks later. Was it the model or my code? Built a small tool to answer this: python examples/model_drift_detector.
by catarina_eng 8mo ago
Same prompt. Same code. Different output weeks later.
Was it the model or my code?
Built a small tool to answer this:
python examples/model_drift_detector.py
If the provider changed behavior between runs:
STATUS=CHANGED rc=2
INTERPRETATION=Same request produced a different response
→ The change came from the model, not your code.
Works offline. No SaaS. Request + response hashes stored in a tamper-evident bundle.
pip install aelitium