6 ms·
Building a Local Perplexity Alternative with Perplexica, Ollama, and SearXNG
- thanksgiving 2y agoCongratulations on front page. AMD GPU support would be nice.
- flybird 2y agoThanks for your comment. AMD GPU support will be available shortly.
- CGamesPlay 2y agoWhat is this Terminus thing? Half the links on the github pages are 404s, the screenshots of applications just link to larger versions of the screenshots, and it seems like it's trying to alternate between being a highly distributed control plane and a homelab service that runs on a raspberry pi.
- flybird 2y agoThanks for your feedback. Appreciate it if you can list some 404 links so that we can fix ASAP, and we will look into other page optimization ideas from you like linkable screenshots as well. To answer your first question, Terminus is a free, self-hosted operating system built on Kubernetes, designed to turn your device/hardware into a homecloud, or a homelab service provider at home as you mentioned. Terminus is supported on Linux, Raspberry, Windows and Mac.
- CGamesPlay 2y agoMany of the ones in https://github.com/beclab/terminus?tab=readme-ov-file#project-navigation https://github.com/beclab/terminus?tab=readme-ov-file#projec... as well as Snowinning in https://github.com/beclab https://github.com/beclab
- flybird 2y agoGot it. Yeah, this section lists 60+ modules/subprojects for Terminus. But as we are iterating fast, some of the project links are not updated in time. We will submit a pr and fix them ASAP. Thanks again.
- rcarmo 2y agoI just did that with docker-compose: https://taoofmac.com/space/notes/2024/06/23/1300 https://taoofmac.com/space/notes/2024/06/23/1300 Much less fuss and zero weird stuff.
- flybird 2y agoCool stuff! Thanks for sharing. Docker Compose is indeed a nice method for fast deployment. But like the difference between FTP and Dropbox Our guide are designed to enable less-pro users to enjoy the benefits of selfhosting at home cloud. A key advantage is fast deployment and flexible assemble of apps like Ollama and Perplexica. In the meantime, compared to Docker Compose, Terminus provides a dedicated domain name for each application and service out-of-the-box. This enables users to access from anywhere via a browser. It will automatically handles all the complicated network configurations, DNS resoluton, and HTTPs certificate.
- Onavo 2y agoLooking forward to your Sandstorm.io successor, k8s is an interesting choice.
- flybird 2y agoThank you for your acknowledgment! We will certainly do our best.
- arendtio 2y agoActually, this 'out-of-the-box' thing makes it complicated for me. Don't get me wrong; I like it when things just work. But when I already have a setup (e.g. traefik + multiple docker-compose environments), I do want to understand what your out-of-the-box setup is doing. Otherwise, I risk that it kills my existing setup. So far I stopped, after I saw, that https://terminus.sh https://terminus.sh is just a script to download another installer.tar.gz
- flybird 2y ago
- jumploops 2y agoSlight correction: I believe Perplexity runs their own search index.
- flybird 2y agoYou are totally right. We kind of simplified the Perplexity workflow in the post for easier understanding. We will definitely be mindful about the accuracy in our future posts.
- akrymski 2y agoGoogle and Bing have been crawling the web for decades. Perplexity crawler is just for marketing purposes, there's no way they even have 1% of Google's index. So yeah, in reality they just query Bing API.
- ktosobcy 2y ago> You’ve probably heard of Perplexity, nope…
- flybird 2y agolol
- voidUpdate 2y agoAm I understanding perplexity right? You put your query into a system that googles it, then pipes the results through an AI to give you an answer? Doesn't google already do that now with their AI summary at the top of the search results?
- kraktoos 2y agoYes
- flybird 2y agoYou're right! This is actually one of people's concerns about Perplexity's future. Additionally, the way I see it, running a local Perplexity alternative is not necessarily for better results, but for better privacy protection. Plus, it's cool.
- drexlspivey 2y agoNo he is not right. They don’t google stuff they maintain their own crawler and index which they query
- voidUpdate 2y agoWho's "he"? Also you might want to contact the author of the post then, because it talks a lot about how Perplexity searches for things on Google
- barkerja 2y agoThe article is not correct. Perplexity has its own crawler and crawls sites directly. The nice thing about Perplexity is its source annotation. It will show you in real time how it's arriving at its data capture(s), and then annotate the results accordingly. It really is a lovely service. It has replaced the "normal" search engine for me, for most of my queries. And has completely replaced ChatGPT/Claude as it can fulfill those needs directly (and even let me choose to use one of those models). They also have an OpenAI-compatible API. I use it in conjunction with https://github.com/thmsmlr/instructor_ex https://github.com/thmsmlr/instructor_ex
- armcat 2y agoPerplexity doesn't actually use Google Search directly. It uses its own indexer and crawler called PerplexityBot [1]. It then uses a mixture of Google and Bing ranking signals to "help" with some of its own search result ranking. I presume they have their own ranker that has some relevancy score based on site recency, cosine similarity of site data with search query, etc, and they combine this with Google and Bing ranking signals. [1] https://nypost.com/2024/06/28/business/amazon-probing-ai-startup-perplexity-for-scraping-sites-without-permission/ https://nypost.com/2024/06/28/business/amazon-probing-ai-sta...
- flybird 2y agoYou are absolutely right. Thanks for correcting and elaborating on this. We used a simplified version (maybe a bit oversimplfiied) to make it easy for the average audience to understand how AI search works. We will be more careful with accuracy in the future.
- pqs 2y agoI tried Perplexity a few times, but I cannot see the point. Are you using it? How is it better than other tools?
- barkerja 2y agoI do use it, because it's replaced the search engine and ChatGPT/Claude for me. It's an all-in-one service that delivers a generally great experience. Both its web and mobile apps are excellent, and they provide an OpenAI -compatible API that lets me do work against their supported models.
- deleted 2y ago[deleted]
- adsharma 2y agoExcept that this can't do auto complete in the URL bar on major browsers, including Firefox. Autocomplete works if you visit localhost:port in the browser. I've asked around. It seems like an anticompetitive behavior on the part of browser vendors.
- oceanplexian 2y agoStep 1) Install an App marketplace. Uhhh, no.