6 ms·
Show HN: Perplexity (llama3 70B) Inline Bot on Telegram
- Oras 2y agoWord of caution when using perplexity to summarize URLs. I have tried the API and had lots of hallucinations. It worked better in the UI, I only had it with the API.
- cpursley 2y agoYeah, I don’t know why their API is inferior to the UI. Pretty disappointing. I’ve had better luck with my own “clone” that makes a web search and summarizes the results into an answer.
- freilanzer 2y agoI've been evaluating OpenAI (GPT-3.5 and -4o) for a project at my company and I have seen differences in quality between the api and the web version as well. Same prompts. The api version seems to vary a lot more in quality.
- egorfine 2y agoPlay around with temperature. Summarization is quite a defined task, so lower the temp a lot.
- freilanzer 2y agoIt's not just that. Following instructions, text generation, etc. all seem to be worse with the api version. At least, when it comes to 3.5 - 4o is much better. Ironically, 4o had problems with correct json output where 3.5 hadn't. It produced ```json {...}``` instead of just the json object.
- stavros 2y agoIs this Perplexity the search engine? Why does it mention Llama in the title?
- rbut 2y agoI'm guessing because perplexity is now based on llama 3. If you look at their labs [1] the choices of models seems to suggest this. [1] https://labs.perplexity.ai https://labs.perplexity.ai
- stavros 2y agoSure, but it's a bit too "under the hood" to mention in something like this, no?
- ramonverse 2y agoI like under the hood info, that is why I am in hackernews :)
- ogrisel 2y agoWhat if perplexity decides to switch to another LLM backbone in the future?
- TechDebtDevin 2y agoThe money is in the app layer and compute. There's no reason to train foundation models to compete with Anthropic, OpenAI, Meta ect ect. Its the equivalent of lighting money on fire.
- oriettaxx 2y agovery bad compare to perplexity https://www.perplexity.ai/ https://www.perplexity.ai/ I asked the time and it is 6 days late: I wrote about the delay and it says I may be pregnant please note that this is not a free service but, most of all, who wrote the bot? who will read what you write there? where is the privacy page? the EU privacy regulation ecc ecc? the web page is not Telegram owned, and the https://www.telegrambots.ai/privacy-policy https://www.telegrambots.ai/privacy-policy I read there does not formal enough to me.... plus,... how can they offer you to add your bot, and at the same time have that privacy policy ? they control the code of my bot ? that "verified" sounds not formal too.. if it is an experiment fine... but it does not looks like it is