n1xis10t

9 ms·

31.
by n1xis10t 8mo ago
“Tell me what to build next.” Alright, build a local meta-search engine that gets as many search pages from it’s sources as the user wants, and then fetches and extracts the text from all the linked results, and then re-ranks them locally a
32.
by n1xis10t 9mo ago
Might be useful as a library
33.
by n1xis10t 9mo ago
It works for me from iOS, I only see sites that end with .ca.gov.
34.
by n1xis10t 9mo ago
Possibly related: https://archive.org/details/search-timeline
35.
by n1xis10t 9mo ago
I don’t understand, why is the fact that google exists news? Did you just discover it?
36.
by n1xis10t 9mo ago
Whenever search engines shut down like this with no explanation, it reminds me of this article in 2600 magazine: https://archive.org/details/search-timeline
37.
by n1xis10t 9mo ago
Whenever search engines shut down like this with no explanation, it reminds me of this article in 2600 magazine: https://archive.org/details/search-timeline
38.
by n1xis10t 9mo ago
Does your server actually have all the tweets and an index? Or when you search does the query go to Twitter’s api?
39.
by n1xis10t 9mo ago
I don’t know exactly what’s going on, but what you describe fits with my experience as well. This article describes events since 2015 that also fit with the same thing: https://archive.org/details/search-timeline Googl
40.
by n1xis10t 10mo ago
Yup, pretty cool right? This article mentions the GSA and talks about some other cool things in the search industry that also went missing around the same time: https://archive.org/details/search-timeline
41.
by n1xis10t 10mo ago
If you keep referring to non-explicit material as pornography, you will continue to confuse people. If you have an objection to the image other than it’s pornographic status, please word it clearly.
42.
by n1xis10t 10mo ago
Hopefully. It would also be nice to see more activity in the actual search engine and archiving market; there really isn’t much right now.
43.
by n1xis10t 10mo ago
No problem! I really don’t know if it’ll work though, I don’t have much experience posting on here.
44.
by n1xis10t 10mo ago
You sound like ChatGPT
45.
by n1xis10t 10mo ago
I do stuff with search engines, not AI agents. If this was based on your own index or if it was based on multiple sources and then re-ranked, I would have been more interested. Knowing that it’s just Google (+ web fetch) though I’m not inte
46.
by n1xis10t 10mo ago
I think "scraper vs siteowners" is a false dichotomy. Scrapers will always need to exist as long as we want search engines and archival services. We will need small versions of these services to keep popping up every now and then
47.
by n1xis10t 10mo ago
I think that most people don't do this, and the ones that do have custom solutions. Xena's uses cron, but that's all I know. It's probably a custom shell script.
48.
by n1xis10t 10mo ago
Could be. Can you train a model without saving things though?
49.
by n1xis10t 10mo ago
Which law is that? Do you have a link to it?
50.
by n1xis10t 10mo ago
Maybe. This comment makes me really want to set something up that builds a map of where all the requests are coming from.
51.
by n1xis10t 10mo ago
Probably any detail that you think is cool, I would be interested in reading about. When in doubt err on the side of too much detail. That was a good read. I hadn’t heard of spintax before, but I’ve thought of doing things like that. Also “
52.
by n1xis10t 10mo ago
Indeed, complexity (both cyclomatic and post-frontal) must be reduced such that the two spurving bearings make a direct line with the panametric fan. For more details consult this instructional video: https://youtu.be/RXJKdh
53.
by n1xis10t 10mo ago
By “doing things to drive traffic to their website” do you mean trying to do SEO type things to manipulate search engine rankings? If so, I think that there are probably ways to rank that are immune to tampering. Don’t worry, you’re not jus
54.
by n1xis10t 10mo ago
That sounds fun, I look forward to reading a writeup about that
55.
by n1xis10t 10mo ago
If people start making search engines again and there is more competition for Google, I think things would be pretty sweet.
56.
by n1xis10t 10mo ago
Puts on tinfoil hat: Maybe it isn’t AI scrapers, but actually is a massive dos attack, and it’s a conspiracy to get people to not self-host.
57.
by n1xis10t 10mo ago
Tough times
58.
by n1xis10t 10mo ago
Oops you just leaked your own intellectual property
59.
by n1xis10t 10mo ago
What do you mean? Would you do even more ridiculous things?
60.
by n1xis10t 10mo ago
So maybe there are more people who like the “anime catgirl” than there are who think it’s weird

More ›