4 ms·
One of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options
by CryptoBanker 11mo ago
One of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options
- asnyder 11mo agoI see Lobe and Chatbox both have prompt caching toggles, are you referring to something else?
- CryptoBanker 11mo agoWhere do you see that? I can't seem to find it in the web or desktop apps for lobechat. EDIT: I also don't see it in Chatbox
- asnyder 11mo agoI've mistakenly given Chatbox a new feature, sorry :). In LobeChat, after you select a particular model, it enables a mini-settings menu next to the model that lets you set caching, deep thinking, and thinking token consumption.
- CryptoBanker 11mo agoAh that must be new since the last time I tried lobechat