2 ms·
If that’s such a large problem then the clear solution is to do sticky sessions? What’s the problem then? Use a cheap ds4 or Luna and do the second model net
by aabdi 2mo ago
If that’s such a large problem then the clear solution is to do sticky sessions?
What’s the problem then?
Use a cheap ds4 or Luna and do the second model net net per one shot best case you save couple dollars per?
- Terretta 2mo agoExactly. There are plenty things they could suggest for that. Anyway you'll likely get a more effective and up to date set of advice by skipping marketing pieces and pointing your favorite frontier model at /r/LocalLLaMA in deep research mode and asking it to synthesize the latest advice, or even try ideas out for itself and let you know what works for your own session history.