renegat0x0

8 ms·

61.
by renegat0x0 9mo ago
A little bit different, but also allows to scrape efficiently. Json http communication rather than cli. https://github.com/rumca-js/crawler-buddy More like a framework for other mechanisms
62.
by renegat0x0 9mo ago
https://rumca-js.github.io/
63.
by renegat0x0 10mo ago
Still working on https://github.com/rumca-js/Internet-Places-Database - database of Internet places https://github.com/rumca-js/crawler-buddy - crawling server https://github.com/r
64.
Show HN: Open database of link metadata for large-scale analysis(github.com)
15 points by renegat0x0 10mo ago|1 comments
65.
by renegat0x0 10mo ago
Also curated list of rss sources https://github.com/rumca-js/Internet-feeds
66.
by renegat0x0 10mo ago
I disagree with a notion that a page needs to work without javascript. It is only design choice of author.
67.
by renegat0x0 10mo ago
How is it different from searxng then?
68.
by renegat0x0 10mo ago
searxng allows me to use various locations https://searx.space/
69.
by renegat0x0 10mo ago
Don't care. I use my own domain index, which also contains youtube channels, which I use through RSS. https://github.com/rumca-js/Internet-Places-Database Most important links are available through a simple search
70.
by renegat0x0 10mo ago
It is a fine project to limit 'doomscrolling', but I think the premise is wrong. - I have created my own RSS readers, that contains 500+ sources. I do not doom scroll - doom scrolling appears when social media algorithm feeds you
71.
by renegat0x0 10mo ago
If anyone is interested in RSS feeds, here are mine in SQLite table: https://github.com/rumca-js/Internet-feeds
72.
by renegat0x0 10mo ago
A browser is a tool that allows you to browse the internet. It should be able to display HTML elements, and stuff. LLMs are also a tool, but it is not necessary for web browsing. It should be installed into a browser as extension, or integr
73.
by renegat0x0 10mo ago
that is hilarious :-)
74.
by renegat0x0 10mo ago
I use my own library of domains exactly for scenarios like that https://github.com/rumca-js/Internet-Places-Database
75.
by renegat0x0 11mo ago
For me capturing list of RSS sources is fun https://github.com/rumca-js/Internet-feeds But i do not check all 3k sources regularly
76.
by renegat0x0 11mo ago
I think I use SQLite like that (to some extent): - https://github.com/rumca-js/Internet-Places-Database For UI I use HTML, because it already provides components with bootrap, and everybody can use it without installat
77.
by renegat0x0 11mo ago
I maintain list of personal domains, together with many other things in a database https://github.com/rumca-js/Internet-Places-Database
78.
by renegat0x0 11mo ago
- Companies had to go in that direction. You cannot just fall behind AI gold rush - These solutions are easier for people, and therefore will win in the long run - these solutions benefit companies because of the surveillance data they have
79.
by renegat0x0 11mo ago
This reminds me that I really like self-hosting. While it is true that many of things do not work, all my services do work. It has some tradeoffs of course.
80.
by renegat0x0 11mo ago
- How many people use only Google search engine nowadays? More and more people use chatbots, with Google search. - Google search also does not provide good results for finding stuff in all walled gardens, so we also use niche search engines
81.
by renegat0x0 11mo ago
Even I, who does not know much, implemented a workaround. I have a web crawler and I have both scraping byte limit and timeout, so zip bombs dont bother me much. https://github.com/rumca-js/crawler-buddy I think garbag
82.
by renegat0x0 11mo ago
F-Droid can not work in the future. Android is controlled by Google. It already tries to block sideloading apps.
83.
by renegat0x0 11mo ago
Still capturing index of the Internet https://github.com/rumca-js/Internet-Places-Database
84.
by renegat0x0 1y ago
- user reports a bug - dev asks vibes for help - llm rewrites half of the files - it does seem to fix the bug - 50 more bugs enter the chat
85.
by renegat0x0 1y ago
I have seen a lot recommends for karakeep. I disagree with people suggesting removing noisy RSS feeds, as some are noisy, yet sometime useful. I think RSS client needs advanced filtering and search. I use my own project for RSS https:&#x2F
86.
by renegat0x0 1y ago
I use RSS to follow these I want to hear. I do not follow recommendation, since RSS reader is my window to the world. I follow even AI slop via reddit RSS. I control however what comes in.
87.
by renegat0x0 1y ago
Searching the web has changed: - There are more walled gardens, so engines legally cannot enter some spaces - There are more legal problems with data, so more things are not accessible - to find stuff you have to check google, but also yand
88.
by renegat0x0 1y ago
Most web scrapers, even if illegal, are for... business. So they scrape amazon, or shops. So yeah. Most unwanted traffic is from big tech, or bad actors trying to sniff vulnerabilities. I know a thing or two about web scraping. There are so
89.
by renegat0x0 1y ago
Mobile is where it is all going. PCs will be like android in the near future.
90.
by renegat0x0 1y ago
I was expecting OneDrive subscription message to go up from time time time.

More ›