asciimoo

5 ms·

61.
by asciimoo 5mo ago
Location: Europe, Budapest Remote: Yes Willing to relocate: No Technologies: Go, Python, svelte, search engines, scrapers, crawlers, data gathering, privacy, free software Résumé/CV: https://github.com/asci
62.
by asciimoo 5mo ago
I'm seeing the same increased activity around my search engine project ( https://github.com/asciimoo/hister ). While Google's decision is very controversial, it's good to see that people are seeking for al
63.
by asciimoo 5mo ago
Nice! Hister provides an MCP interface so you can easily integrate it to your RAG setup.
64.
by asciimoo 5mo ago
Yes, the extension extracts the content of the tabs as your browsers renders them. This includes applying all your extension's modifications as well.
65.
by asciimoo 5mo ago
Thank you for your feedback, it's super useful to get insights from users. I agree, browser import has rough edges. The issue you mentioned is known: https://github.com/asciimoo/hister/issues/31 . I try
66.
by asciimoo 5mo ago
This is an awesome idea in theory, I'd love to go to this direction, but it's a surprisingly complex topic. I find it hard to come up with an implementation that can guarantee both result quality (no malicious actors) and user pri
67.
by asciimoo 5mo ago
> If I wanted to use use my domain list to start hister, to download my preconfigured / like domains? Yes, Hister has a built-in crawler which supports standard HTTP and different browser based backends > Can I make some pages to
68.
by asciimoo 5mo ago
It isn't supported yet, but it's a good idea and quite simple to implement it. I've added it to the issue tracker: https://github.com/asciimoo/hister/issues/431 . Thanks for the suggestion.
69.
by asciimoo 5mo ago
Ohi, I'm the author of the open source Searx metasearch engine. I'm working on a self-hosted search service called Hister with the same goal when I started Searx development: reduce dependence on online search engines. Hister is a
70.
by asciimoo 5mo ago
Ohi, author here! Feel free to A.M.A.
71.
by asciimoo 5mo ago
> Of course, but this is true for any project or any language, can hardly be disrespectful of me to chose Clojure just because you don't happen to know it? Nobody said that the problem is not knowing rust. The problem is changing th
72.
by asciimoo 5mo ago
> For who? What you say is true for everyone who doesn't know Rust (before Zig), and not true for everyone else, same as it always is been, for every single FOSS project out there. Even if you are fluent in rust, it is going to requ
73.
by asciimoo 5mo ago
The difference is exactly the speed. Slowly transitioning from one thing to another gives the opportunity to contributors to get involved in the process.
74.
by asciimoo 5mo ago
> Is it disrespectful if my proposed feature was merged, but then later was removed because the maintainer just didn't want the feature anymore? No, the big difference is that the described scenario does not require getting familiar
75.
by asciimoo 5mo ago
Regardless the outcome, this is such a disrespectful move towards the huge amount of contributors who invested time and effort to learn the project and make it better. I hope the zig/dev community forks the project and continues the de
76.
by asciimoo 5mo ago
I'll continue to work on https://github.com/asciimoo/hister as much as I can. I plan to add new extractors and optimize the indexer storage usage by moving out HTML/favicon content from the index and storing
77.
by asciimoo 7mo ago
Thanks <3 Currently it overwrites the previous content with the latest if there is any change, but I'd like to add option to store diffs as well in the future.
78.
by asciimoo 7mo ago
I'm working on a self-hosted search service called Hister with the goal to reduce my dependence on online search engines. Hister is basically a full text indexer which saves all the visited pages rendered by your browser. It provides a
79.
by asciimoo 8mo ago
Ohi, author here. The index you build can indeed contain sensitive data, but you have the ability to specify URL patterns to skip the indexing of the matching pages.
80.
Show HN: Hister – fast, content-based search for visited websites(hister.org)
9 points by asciimoo 8mo ago|1 comments
81.
Show HN: Omnom v0.8.0 with Fediverse feed integration(github.com)
6 points by asciimoo 11mo ago|0 comments
82.
by asciimoo 1y ago
I'm using & developing Omnom (read-only demo: https://omnom.zone/ ). It is self-hosted, free software, fediverse compatible and creates 1:1 snapshots of the saved websites: https://github.com/asciim
83.
by asciimoo 2y ago
It's not only open source, it is free software. Take a look at https://github.com/asciimoo/omnom - suggestions/contributions are appreciated =)
84.
by asciimoo 2y ago
You can find detailed search (including title/content) using the bookmarks endpoint. Snapshot search is currently only for finding multiple snapshots for a single URL/domain. Probably it should be emphasized, or content based sear
85.
Show HN: Omnom – Bookmarking with Website Snapshots(github.com)
7 points by asciimoo 2y ago|0 comments
86.
by asciimoo 9y ago
Makes sense, thanks =) In the above example this would require `nil` checking of the retrieved value every time. I'm not sure if it would make the API cleaner
87.
by asciimoo 9y ago
How do you recognize if the collector has finished? If the site doesn't contain "a" elements (e.g. because of a network error), this example would block forever.
88.
by asciimoo 9y ago
Scraping JS-only sites is also possible without a headless browser, but requires a bit more debugging of the internal structure of these sites. Most of JS-only websites have API endpoints with JSON responses, which can make scraping more re
89.
by asciimoo 9y ago
Interesting idea, how do you imagine a channel based API for this?
90.
Colly: Fast and Elegant Scraping Framework for Golang(github.com)
120 points by asciimoo 9y ago|58 comments

More ›