3 ms·
Which model did you pick? It defaults to 7B which wouldn't be expected to be the brightest of the bunch. If you pick their 70B model it says: "I am Perplexity"
by raylad 3y ago
Which model did you pick? It defaults to 7B which wouldn't be expected to be the brightest of the bunch.
If you pick their 70B model it says: "I am Perplexity".
- stavros 3y agoMistral 7B is very good, definitely way better than such confusion.
- furyofantares 3y agoThe default here is pplx-7b-online which I'm thinking is not instruct-tuned. There's also pplx-7b-chat which doesn't appear to exhibit this confusion and I think is instruct-tuned. Very strange default for them to choose imo.
- stavros 3y agoAh, yes, just today a friend was having lots of trouble with Mixtral returning terrible results, until he got Mixtral-instruct. Very interesting how much better the UX of instruct models is.
- cosmojg 3y agoI think it's a matter of setting expectations appropriately. LLMs aren't chatbots by default, they're text prediction engines. Depending on the use case, the instruct-tuned models can be quite a bit more difficult to use.
- stavros 3y agoFor the average person, the text completion mode is very unintuitive. Even my friend, who's a very experienced developer, had issues with the non-instruct model, even after I told him he needs to structure his queries as completions.
- quickthrower2 3y ago70B seems more awake for sure