16 ms·
Phind-405B and faster, high quality AI answers for everyone
- rainbowjelly 2y agoI get a blank page with the text "Service is unavailable in this region." Any reason why Phind is region-locked? Is there a list of what countries Phind is available in?
- zx8080 2y agoInteresting. I'm not working for phind, but can you share which region are you trying to access it from?
- rainbowjelly 2y agoI tried to access it from Malaysia. VPN works but I’d rather not.
- johndough 2y agoFor me, the website says: "Sorry, you have been blocked. You are unable to access phind.com"
- rushingcreek 2y agoSorry about that, can you please email me at hello(at)phind(dot)com?
- johndough 2y agoSure! I've contacted you. Edit: It has been resolved for me. Thank you!
- deleted 2y ago[deleted]
- mathfailure 2y agoFor me it says The inference service may be temporarily unavailable - we have alerts for this and will be fixing it soon.
- mritchie712 2y agoDoes anybody use Phind? What do you use it for?
- fkyoureadthedoc 2y agoI use it periodically for things that I'd typically search on google and then read stack overflow for. I started this workflow before chatgpt had web search, so might be irrelevant now, but I've found it decent. Back then it was nice to be able to see the sources vs chatgpt just giving a random answer from who knows where.
- sgc 2y agoI use it, with the phind models, instead of chatGPT. I had to change my user agent to Chrome since too many sites would refuse to work with FF otherwise, and now chatGPT is stuck in an endless captcha loop whenever I go there. I am just a casual user, to help write a quick script or to get some bit of relevant info. It works just as well or better for my use case, and of course having actual citations with links is worlds better than just playing "guess the hallucination". I am happy chatGPT kicked me out.
- TaylorAlexander 2y agoMy friend has the endless captcha loop on ChatGPT too. Does anyone know how to fix it?
- jncraton 2y agoIt would be nice to see the Phind Instant weights released under a permissive license. It looks like it could be a useful tool in the local-only code model toolbox.
- deleted 2y ago[deleted]
- NelsonMinar 2y agoPhind continues to be my favorite AI-enhanced search engine. They do a really nice job giving answers to technical questions with links to references where I can verify the answer or learn more detail. Some recent examples from my history: what video formats does mastodon support? https://www.phind.com/search?cache=jpa8gv7lv54orvpu2c7j1b5j https://www.phind.com/search?cache=jpa8gv7lv54orvpu2c7j1b5j compare xfs and ext4fs https://www.phind.com/search?cache=h9rmhe6ddav1bnb2odtchdb1 https://www.phind.com/search?cache=h9rmhe6ddav1bnb2odtchdb1 on an apple ][ how do you access the no slot clock? https://www.phind.com/search?cache=w4cc1saw6nsqxyige7g3wple https://www.phind.com/search?cache=w4cc1saw6nsqxyige7g3wple The answers aren't perfect. But they are a good gloss and then the links to web sources are terrific. ChatGPT and Claude aren't good at that. Bing CoPilot sort of is but I don't like it as much.
- rushingcreek 2y agoThank you! We think there's quite a bit of room for improvement still and are working on better answer organization and verifiability.
- smusamashah 2y agoI see references here but when I ask questions, I get answer but no citations, and I am logged in. This used to be an issue but was fixed but still an issue for me. If I logout and ask I get reference but the answers are using instant model.
- NelsonMinar 2y agoI've noticed that sometimes too. I think it depends on the type of question, sometimes Phind decides you don't need references. You can ask explicitly for them. Kagi does the opposite: it's mostly search results but sometimes an AI gives you a "Quick Answer" too.
- jadbox 2y agoIn my tests, it does hallucinate answers, even with Phind 70B. For example, I asked for bluetooth earplugs that have easy battery replacements. It always kept giving me answers for earplugs with I know have their battery soldered into the casing. Tbf, perplexity also fails at this question.
- ashleyn 2y agoI was a Phind user for a bit but I've switched to Perplexity lately. Anyone know how the two compare?
- rushingcreek 2y agoWe should have higher quality and faster answers across the board with this new update. Would love to hear your thoughts.
- fshr 2y agoIt'd be cool if you showed off and did your own comparison and posted it on your blog. It'd also be cool if your blog was sorted newest to oldest - it's currently the reverse.
- dsp_person 2y agoHmm this versus Kagi Assistant? Plan page says $20/mo Unlimited powerful Phind-405B and Phind-70B searches; Daily GPT-4o (500+) , Claude 3.5 Sonnet (500+), Claude Opus (10) uses > Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet. Any other benchmarks?
- freehorse 2y ago> Hmm this versus Kagi Assistant? It has a vscode extension. So if you use that, it makes some sense. Purely for search, I dont know. Ime phind is not that great with internet access, sometimes people disable the search function to get better answers.
- rushingcreek 2y agoHave you tried the new internet answers that are a part of this update?
- freehorse 2y agoNot really, as I do not have subscription anymore. Is it better compared to no-internet-access?
- nicce 2y agoI payed and used 6 months for Phind. I am more satisfied with the Kagi Assistant currently. It does not give that many links but overall results are as good or even better, and you can use lenses. You get general search engine too. There was one UI related annoyance with Phind; scroll bar sometimes jumped randomly, maybe even after each input or during token generation (on Firefox). You start wasting a lot of time if you always need to find again the part you were looking. Or even just scrolling back to bottom. Primary issue is still that both hallucinate too much when you ask something difficult. But that is the general problem everywhere.
- rushingcreek 2y agoThanks for the feedback. We've fixed the UI jumping issue. The new Phind update today should also work as a general search engine.
- thibran 2y agowow it finds the correct answer to a Scheme niche language question. "How to replace a string in Gerbil Scheme?"
- Citizen_Lame 2y agoCan the new model provide creative writing with high token context or is Phind purely focused on answering questions (enhanced search).
- rushingcreek 2y agoIt can, via our Playground mode, but it’s not optimized for that. Phind-405B does seem to generate good poems though.
- hleszek 2y agoAre the weights available since it's based on Meta Llama 3.1 405B?
- TacticalCoder 2y agoSerious question: does the Meta LLama ToS / EULA even allow fine-tuned models based on Llama to be used for commercial purposes without making the weights available?
- darwinwhy 2y agoI believe it does unless you're another tech giant with billions of users / revenue.
- jmakov 2y agoPhind is the best productivity booster I've found in the last years. Congrats and keep up the great work!
- rushingcreek 2y agoThank you!
- FofXisNull 2y agoHey can you enhance the "clear history" button so that it doesn't delete your pinned threads? Also if you can improve the threads area with folders for better organization that would be awesome. Great work on the product btw!
- rushingcreek 2y agoGreat feedback!
- itorcs 2y agoBeen subscribed to phind pro for the last 5 or 6 months I think? Feels like the pollution from search results has gotten a bit better but it sometimes still messes with answers when I ask a follow up question. Like I will reference the answer aboves code in my question, and the next answer will answer based not on the conversation but some code in the search results. I'm not versed enough in rag to know how you would fix that with like a prioritization or something. Other than that I'm REALLY looking forward how you guys tackle your own artifacts in the web interface. Something about that ui in Claude's version of artifacts works really well with my work flow when using the web, plus having the versions of different files, etc.
- rushingcreek 2y agoWe're working on artifacts :) May I ask which models you're seeing the pollution with?
- itorcs 2y agoHas happened with both 4o and sonnet, probably 4o more if I had to say for sure. I need to use 405 more to see if it has that same problem. I guess I didn't think about how the issue might be better or worse depending on model, I assumed the rag stuff applied the same
- deleted 2y ago[deleted]
- BikeShuester 2y agoI'd suggest offering at least one free query to allow users to evaluate the service.
- rushingcreek 2y agoOur fast model, Phind Instant, is completely free
- johndough 2y agoMaybe OP was referring to Phind-405B (the model from the article). I certainly wonder how good the 405B model really is.
- cjtrowbridge 2y agoIt's just an innovated (enshittified) version of Facebook's free 405b model.
- fshr 2y agoWhy not let us try the new model for free like the 5 uses available for the 70B model? Seems like a no brainer to hook new users if what you're selling is worth it, eh?
- swyx 2y ago> The model, based on Meta Llama 3.1 8B, runs on a Phind-customized NVIDIA TensorRT-LLM inference server that offers extremely fast speeds on H100 GPUs. We start by running the model in FP8, and also enable flash decoding and fused CUDA kernels for MLP. as far as i know you are running your own GPUs - what do you do in overload? have a queue system? what do you do in underload? just eat the costs? is there a "serverless" system here that makes sense/is anyone working on one?
- rushingcreek 2y agoWe run the nodes "hot" and close to overload for peak throughput. That's why NVIDIA's XQA innovation was so interesting, because it allows for much higher throughput for a given latency budget: https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/XQA-kernel.md https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source.... Serverless would make more sense if we had a significant underutilization problem.
- asadm 2y agoAny perplexity pro user tried Phind? how good is it? specially for code/tech research etc.
- BigLasagne 2y ago[dead]
- jadbox 2y ago"Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet". I'd love to see examples of actual code modifications created by Phind and Sonnet back-to-back. This level of transparency would give me the confidence to try to pro. As it is, I'm skeptical by the claim and actual performance as I've yet to see a finetuned model from Llama3.1 that performed notably better in an area without suffering problems in other areas. We do need more options!
- rushingcreek 2y agoThe effectiveness of any given model depends on the specific use cases. We noticed that Phind-405B is particularly good at making websites and included some zero-shot examples in the blog.
- Simorgh 2y agoI’ve been a customer of Phind for a number of months now, so I’m familiar with the capabilities of all the models they offer. I found even Phind-70B to often be preferable to Claude Sonnet and would commonly opt for it. I’ve been using the 405B today and it seems to be even better at answering. I’ve found it does depend on the task. For instance, for formatting JSON in the past, GPT-4 was actually the best. Because you can cycle through the models, you can check the output of each one, to get the best answer.
- xwolfi 2y agoTbh formatting JSON... should be a solved problem already for the last decade, why consume AI resources for that ??
- deleted 2y ago[deleted]
- trees101 2y agoHopefully it gets evaluated on this leaderboard https://aider.chat/docs/leaderboards/ https://aider.chat/docs/leaderboards/
- J_Shelby_J 2y agoAccessible by api?
- natrys 2y agoDoes an API not make economic sense for you? Personally I would rather use my own tooling (not VSCode based).
- rushingcreek 2y agoSo far an API has been less of a priority than focusing on the user-facing product. But it seems there's a reasonable amount of demand for it, which we'll consider.
- therealmarv 2y agoI consider AIs without API access even as non existent. Not everybody wants a web interface and waste time on copy&paste all the time. APIs can hook the filesystem directly with an AI, make complicated prompt engineering and multi file changes a non-issue. And they should also help you to make more money (don't undersell the API access and you're fine). Without an API the community can also not compare Phind-405B to other models easily. Would be great to have access to your model in a LLM gateway like https://openrouter.ai/ https://openrouter.ai/ I would give your API a try as minimum.
- nickpsecurity 2y agoYou should also consider the ecosystem value that might be created for your product. There’s a prior example. ChatGPT amazed people but its UI didn’t. A bunch of better UI’s showed up building on the OpenAI API and ChatGPT own. They helped people accomplish more which further marketed the product. You can get this benefit with few downsides if you make the API simple with few promises about feature. “This is provided AS IS for your convenience and experimentation.”
- lerchmo 2y agoI think an API would be fantastic for use cases like Aider / SWE agents. The primary issue besides fully understanding the code base is having up-to-date knowledge on libraries and packages. Perplexity has "online" models. And phind with Claude, GTP-4o, Phind 70 + search / rag would be awesome.
- 11101010001100 2y agoLooks cool, but anyone not familiar with 'founder mode' will be confused....
- spirodonfl 2y agoI just tried. Asked a question on a research topic I'm digging into. It gave me some answers but no references. Then I copy the answers it gave me and specifically ask for references. Then I got: I sincerely apologize for my earlier response. Upon reviewing the search results provided, I realize I made an error in referencing those specific studies. The search results don't contain any relevant information for the claims I mentioned earlier. As an AI assistant, I should be more careful in providing accurate and supported information. Thank you for bringing this to my attention. In this case, I don't have reliable references to support those particular statements about software tools and their impact on developer experience and software quality. Not sure about this...
- rushingcreek 2y agoSorry about that, could you make sure that "Always search" is enabled and try that first query again? It should be able to get the correct answer with references.
- spirodonfl 2y agoIt was on. If I ask the same question again it now gets the right answer. Maybe a blip? Not sure. To be fair, I don't expect these AI models to give me perfect answers every time. I'm just not sure people are vigilant enough to ask follow up questions that criticize how the AI got the answers to ensure the answers come from somewhere reasonable.
- mokkun 2y agoI found that quite often even though the always search option is on, it won’t search at times; maybe that was the case here.
- spirodonfl 2y agoJust to follow up on this: I asked it to give me a brief explanation on how to use laravel 11 blade fragments, which it did reasonably well. I then offered 3 lines of code of a route I'm using in Laravel and I asked to tell me how to implement fragment usage where the parameter in the url determines the fragment returned. Route::get('/vge-frags/{fragment}', function ($fragment) { return view('vge-fragments'); }); It told me to make sure I have the right view created (which I did) and that was a good start. Then... It recommended this? Route::get('/vge-frags/{fragment}', function ($fragment) { return fragment($fragment); }); I immediately knew it was wrong (but somebody looking to learn might not know). So I had to ask it: "Wait, how does the code know which view to use"? Then it gave me the right answer. Route::get('/vge-frags/{fragment}', function ($fragment) { return view('vge-fragments')->fragment($fragment); }); I dunno. It's really easy to find edge cases with any of these models and you have to essentially question everything you receive. Other times it's very powerful and useful.
- minkles 2y agoI asked it a question and it answered authoritatively. > The impedance of a 22 μH capacitor at 400 THz is approximately 1.80 × 10^-24 Ω. The correct answer should have been “what the hell are you talking about dumbass?”. Capacitors are not measured in henries and the question really has no meaning at 400THz. Another stochastic parrot.
- CamperBob2 2y agoAt 400 THz any real-world capacitor will look inductive. :-P Although it's not gonna look like 22 uH.
- IanCal 2y agoThe 405B model for me brings out a formula for calculating this, explains that my question doesn't make sense given that capacitors are measured in F instead and then plugs the values in assuming I made a mistake and meant 22uF. It then explains that in practice other factors would dominate and the frequency is so high traditional analysis doesn't make so much sense. https://www.phind.com/search?cache=ns6ojo1obnomkerccup9nm3r https://www.phind.com/search?cache=ns6ojo1obnomkerccup9nm3r
- davidcollantes 2y agoThe “About” is not “Who we are” at the time I am typing this. Please add information about the company, founders, etc. It looks good, thought!
- josvdwest 2y ago"A key issue with AI-powered search is that it is just too slow compared to classic Google. Even if it generates a better answer, the added latency is discouraging." Is this true? I feel like most complaints I have and hear about is how inaccurate some of the AI results are. I.e. the mistakes it confidently makes when helping you code.
- loktarogar 2y agoI think they're both key issues - when the results are accurate, they're too slow; and you can't trust the results when you get there because they're often inaccurate
- Terretta 2y agoFrom hitting enter to seeing something, ofc it's slower. From hitting enter to a set of relevant answers loaded into your brain, though? Isn't that the goal that should be measured? Against that goal, the two decade old approach seems to have peaked over a decade ago, or phind wouldn't find traction. For the 20 year old page rankers, time from search to a set of correct answers in your brain is approaching “DNF” -- did not finish. --- PS. Hallucinations or irrelevant results, both require exercising a brain cell. On a percentage basis, there are fewer hallucinations than irrelevant results, it's just that we gave up on SERP confidence ages ago.
- caskstrength 2y agoThis is true in my experience. Before searching for something I often try to guess whether it will take me more time to quickly go over Google results or watch Perplexity Pro slowly spitting the answer line-by-line.
- moffkalast 2y agoIt's one of those triangles with speed \ accuracy / cost. You can have a small model that's cost effective to serve, and gives fast responses, but will be wrong half the time. Or you can have a large model that's slow to run on cheap hardware, but will give more accurate answers. This is usually only fast enough for personal use. And the third option with a large model that's fast and accurate, and you'll have to pay Nvidia/Groq/etc. a small fortune to be able to run it at speed and also probably build a solar powerplant to make it cost effective in power use.
- lxe 2y agoIs Phind similar to Perplexity?
- rawrawrawrr 2y agoTitle says "for everyone", but post says "Phind-405B is available now for all Phind Pro users". I guess everyone on earth has paid for Phind :)
- rushingcreek 2y agoThe "for everyone" part is about the new Phind Instant, trained using similar data to Phind-405B, which is great at fast information retrieval
- RIMR 2y agoThe AI generated page that attributes Steve Jobs' success to Paul Graham is killing me.
- swyx 2y agoyou have cause and effect reversed. PG's post directly cites Brian Chesky and Steve Jobs in the post as founder mode inspirations.
- kamatchu07 2y agoIs not for everyone as title said . It is just for pro users . The title is confusing . Can you please change it
- deleted 2y ago[deleted]
- neilv 2y agoTheir example is: stealing content, to make a sketchy-looking pile of worthless BS. Then I realized that this pattern is the biggest application of LLMs right now. So I guess they're just acknowledging the target market.
- mountain_goat 2y agoI've been using Phind this past week and it's been excellent. One of our vendors insisted on whitelisting the IPs we were going to call them from, and our deployments went through AWS copilot/Fargate directly to the public subnets. Management had fired the only person with infrastructure experience a few months ago (very small company), and nobody left knew anything about networking. Within about a week, Phind brought me from questions like "What is a VPC?" "What is a subnet?" to having set up the NAT gateways, diagnosing deploy problems and setting up the VPC endpoints in AWS' crazy complicated setup, and gotten our app onto the private subnet and routing outbound traffic through the NAT for that vendor. Yes, it occasionally spit out nonsense (using the free/instant model). I even caught it blatantly lying about its sources once. Even so, once I asked the right questions it helped me learn and execute so much faster than I would have trying to cobble understanding through ordinary google searches, docs, and blog posts. Strongly recommended if you're ever wading into a new/unfamiliar topic.
- thruway516 2y agoHow does it compare to Perplexity or even plain vanilla ChatGPT? Did you specifically seek to use Phind because you weren't satisfied with others? Or did it just happen to be the first one you used?
- mountain_goat 2y agoJust happened to be the first one I used! The day after this thread hit the front page, I tried perlexity.ai b/c Phind was overloaded with traffic and not responding. It was ok, but not quite as helpful. Too hard to tell whether that's a fair judgment of the services or just because I don't have as much to ask as I did a week ago though.
- CSMastermind 2y agoOkay, wait this is actually doing a really good job. I still have to ask follow up questions to get reasonable results but when I tested earlier this year it was outright failing on most of my test queries.
- rushingcreek 2y agoThat’s great to hear! What are you asking it?
- CSMastermind 2y agoThese are the types of questions I want to ask it: > What degrees are held by each of the current Fortune 100 CEOs? > What job did each of the current NFL GMs hold before their current position? > Which genre would each of the current Billboard Hot 100 songs be considered part of? > How many recipients of the Presidential Medal of Freedom were born outside of the US? > Which US car company has the most models in their 2025 line-up across all of their brands? It can't handle those directly right now. You need to break the problem down step by step and sort of walk it through gathering the data with follow up questions. But much better than it used to be.
- druskacik 2y agoThere is a method that could help immensely when answering questions like these. E.g. some of these question may be answered quite quickly using WikiData [0] (answer to question about the recipients of Medal of Freedom, query written with the help of Claude), instead of just scraping and compiling information from potentially hundreds of websites. I believe this idea is quite under-explored compared to just blindly putting everything to the model's context. [0] https://query.wikidata.org/#SELECT%20%28COUNT%28DISTINCT%20%3Fperson%29%20AS%20%3Fcount%29%20%3FcountryLabel%0AWHERE%20%7B%0A%20%20%3Fperson%20wdt%3AP166%20wd%3AQ17144%20.%20%20%23%20Person%20received%20Presidential%20Medal%20of%20Freedom%0A%20%20%3Fperson%20wdt%3AP19%20%3FbirthPlace%20.%20%20%23%20Person%27s%20place%20of%20birth%0A%20%20%3FbirthPlace%20wdt%3AP17%20%3Fcountry%20.%20%23%20Country%20of%20birth%20place%0A%20%20%0A%20%20FILTER%28%3Fcountry%20%21%3D%20wd%3AQ30%29%20%20%20%20%23%20Filter%20out%20United%20States%20%28Q30%29%0A%20%20%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%7D%0AGROUP%20BY%20%3FcountryLabel%0AORDER%20BY%20DESC%28%3Fcount%29 https://query.wikidata.org/#SELECT%20%28COUNT%28DISTINCT%20%...
- codedokode 2y agoI think that LMM should not produce answers to questions. Instead, they should generate keywords, make keyword search and give quotes from human-written material as an answer. So what LLM should do is only search and filter human-written material. An example of search query is "What is the temporal duration between striking adjacent strings to form a chord on a guitar?". Google (being just a dumb keyword search engine) produces mostly unrelated search results (generally answering what chords there are and how does one play them). Phind also cannot answer: [1] However, when I asked a LLM what keywords I should use to find this, it suggested "guitar chord microtiming" among other choices, which allows to find a research work containing the answer (5 to 12 ms if someone is curious). [1] https://www.phind.com/search?cache=u4xiqluairg3zkdaxstcr39v https://www.phind.com/search?cache=u4xiqluairg3zkdaxstcr39v
- deleted 2y ago[deleted]
- jeffybefffy519 2y agoIve given up on phind. The company seems like a bit of a dodgy black hole in terms of what they do with information (the answer is - i dont know, but i requested to try find out so my company could use them and got no reply). Seems untrustworthy…
- TekMol 2y agoSneaky title. Bread and water for everyone now apparently means Bread for our customers, water for everyone
- nonotanymore 2y agoThis is incredible. Truly the evolution of documentation! It makes going through docs in Python so much easier.
- shultays 2y agoRecently I asked an AI following question const MyClass& getMyClass(){....} auto obj = getMyClass(); this makes a copy right? And it was very confident about it not making a copy. It thinks auto will deduce the type as a const ref and not make a copy. Which is wrong, you need auto& or const auto& for that. I asked it if it is sure and it was even more confident. Here is the godbolt output https://godbolt.org/z/Mz8x74vxe https://godbolt.org/z/Mz8x74vxe . You can see the "copy" being printed. And you can also see you can call non-const methods on copied object, which implies it is a non-const type I asked the very same question to phind and it gave the same answer https://www.phind.com/search?cache=k3l4g010kuichh9rp4dl9ikb https://www.phind.com/search?cache=k3l4g010kuichh9rp4dl9ikb How come two different AIs, one was supposed to be specialized on coding, fails in such a confident way?
- prosunpraiser 2y agoYou prove the point that these are just token generation machines whose output is psuedo-intelligent. It’s probably not there yet to be blindly trusted.
- fennecfoxy 2y agoMore to the point; I wouldn't blindly trust 99% of humans, let alone a machine. Though to be fair we will hopefully quickly approach a point where a machine can be much more trusted than a human being, which will be fun. Don't cry about it, it's our collectives faults for proving that meat bags can develop ulterior motives.
- renewiltord 2y agoOne of the oldest tricks to make LLMs perform better is to ask them to "think step by step". I asked your question to Claude with that one ``` const MyClass& getMyClass(){....} auto obj = getMyClass(); ``` Does this make a copy. Let's think step by step. This might help you if you're trying to get these to help you more often.
- atemerev 2y agoSome time ago, you promised to release the weights for Phind-70B. Do you still plan to do this?
- amelius 2y agoGovernment institutions (academia) should be training these kinds of networks (or funding it) so they become accessible to everybody and truly "open".
- ewuhic 2y agoHow well does Phind operate in uncommon languages, say, the Uyghur language?
- enum 2y agoThis is going to be renamed to Llama Phind 405B, right?
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- cocodill 2y agoa really good benchmark for such systems: ask them to summarize the reasons to vote for Trump or Harris.
- KETpXDDzR 2y ago> [...] faster, high quality AI answers for everyone ...if you buy their pro subscription
- garfieldnate 2y agoBoy I would love something like this for electronic parts datasheets.