renegat0x0

8 ms·

91.
by renegat0x0 1y ago
I use python poetry, i have not genereted requirements file for a long time. For current deps you can check pyproject file. I do not use feedparser, because it could not parse properly some rss files. I implemented my own lib for rss parsin
92.
by renegat0x0 1y ago
I run something I call an "ethical crawler". It’s designed to avoid being a burden to websites - it makes requests very infrequently. Crawling the internet reliably has become increasingly difficult, as more and more content is pr
93.
by renegat0x0 1y ago
Not really sure if that counts but I also created a db centered app. I do a lot of meta link archiving and I wanted to create a link browser. My project supports data in zipped sqlite, or JSONs. I believe data are as much important as progr
94.
by renegat0x0 1y ago
Still gathering internet links https://github.com/rumca-js/Internet-Places-Database Still crawling framework https://github.com/rumca-js/crawler-buddy Still RSS client https://github.co
95.
by renegat0x0 1y ago
I self host my Search Engine / RSS reader. I track every page I visit from nearly all devices. Since my basic search engine is self hosted nobody actually sees what I visit, and what I watch. This is my conclusion seeing that social me
96.
by renegat0x0 1y ago
Some links https://github.com/AboutRSS/ALL-about-RSS https://github.com/plenaryapp/awesome-rss-feeds My problem with most RSS do not have great search. With 500+ sources this can become problem.
97.
by renegat0x0 1y ago
Dogs will always bark. I daily drive linux, and I am happy with it. Majority will not make the switch because they either are dependent on the office, adobe, or video editing software. Linux user base grows. One tiny percent of percent ever
98.
by renegat0x0 1y ago
Two things: - I wanted to install minecraft for my boy. I couldn't just start a game. It required me to tie in account to the system. First I don't like that. Second is that we have lost pin, and could not remember password or som
99.
by renegat0x0 1y ago
- I can confirm that the web archive can be really slow - I think I have seen that AI scrapers create bottleneck in the bandwidth - To some digital archives you need to create scientific accounts (I think Common Crawl works like that) - Dat
100.
by renegat0x0 1y ago
Most people complain about the signal-to-noise ratio in news consumption. I believe the issue isn’t the news sources themselves, but rather the lack of a proper RSS application. A great RSS app should offer a powerful search function. It sh
101.
by renegat0x0 1y ago
What I have seen it is hard to tell what "serious scrapers" use. They use many things. Some use this, some not. This is what I have learned reading webscraping on reddit. Nobody speaks things like that out loud. There are many too
102.
by renegat0x0 1y ago
There are two sides of the story, as usual - we already have some forms of IDs. Most of us have personal ID, driving license, you data exist in government tables - we already have some forms of IDs online. Everything is stored per email add
103.
by renegat0x0 1y ago
Whoa. That is 20% more than I thought
104.
by renegat0x0 1y ago
I maintain my own link meta archive. Just because I know that it will stay, but I am aware of link rot. I know also that internet archive exists, and also I know that it works painfully slow. I want to be able to at least browse headlines a
105.
by renegat0x0 1y ago
- there is no escape from digital techno feudalism - you will have to obey corporations - sooner or later everything will work using digital ID, or some other IDs - sooner or later phones, PCs, browsers, will be locked in - majority of popu
106.
by renegat0x0 1y ago
Yesterday I seen someone claiming on Reddit that they stopped using mailing list in favour of using rss
107.
by renegat0x0 1y ago
I was wondering whether old web means people, or the old web is entirety of old web. Certainly companies will not provide features of old. No RSS for you, since they want to control what you see with the "algorithm". What about pe
108.
by renegat0x0 1y ago
That is why I use my own domain index https://github.com/rumca-js/Internet-Places-Database
109.
by renegat0x0 1y ago
I think it is not about making a change, it is putting money where your mouth is. To buy premium to support creators. Once yt becomes hostile the deal between me and yt is off.
110.
by renegat0x0 1y ago
Microsoft new about piracy, and used it to become popular. YouTube plays a game with downloaders to be and stay popular, supported even by niche devices. On the other hand they will use vague license statements to strike opponents. Even RSS
111.
by renegat0x0 1y ago
I performed some transition from django pure template solution to more javascript oriented. - my server was running on raspberry PI, now heavy responses are returned via JSON, I think REST-like data. Which makes me offload burden to clients
112.
by renegat0x0 1y ago
thanks, I replaced it with a other link demo
113.
by renegat0x0 1y ago
Any link list, or domain list is not worth much without any rating, or meta. I lead a hobby project, and I am not expert, so I provide ratings based on what kind of data pages provide (title, social, description), and my own manual voting s
114.
by renegat0x0 1y ago
Well, I created my own domain index. I have not crawled every page inside domains, but it is not my goal. I have 1542766 domains. Might not be much, but it is an honest work. It is available as a github repo, so anybody that wants to start
115.
by renegat0x0 1y ago
- I still use RSS - Some major platform still provide RSS, which makes me use them (I do not use twitter, because it does not provide RSS - If not for RSS I would not be using Reddit - the moment platform drops RSS, I drop the platform Link
116.
by renegat0x0 1y ago
To be honest most of my apps are web pages now. Even on my phone I do not use any more than the default apps. For what is missing I have written my own self-hosted pages. I sometimes wonder why people "synchronize" anything, since
117.
by renegat0x0 1y ago
Huh, I thought that AI was made to be magic. Click and it generates code. Turns out it is like magic, but you are an apprentice, and still have to learn how to wield it.
118.
by renegat0x0 1y ago
I use my own RSS reader [0]. I found other to be lacking in some areas. I use it also for: - bookmarks - web crawling - simple search engine I also created simple RSS reader/parser, and web crawling system [1]. Links: [0] https:/
119.
by renegat0x0 1y ago
I think that people who say they prefer keeping a simple file has never found a good app for bookmarking. There is still a space for killer app with bookmarks. I think that simple URL bookmarking is just wrong. It simply will not work for b
120.
by renegat0x0 1y ago
I use spacy in my raspberry pi project. I am not sure I want to use LLM for analyzing words in it.

More ›