anthonyhn

5 ms·

1.
by anthonyhn 2y ago
First off, I want to thank you and the other members of the CC Foundation, the CC data set is an incredible resource to everyone. Much of the UA data, including CCBot, is from an upstream source[0]. I was torn on whether CCBot and other arc
2.
by anthonyhn 2y ago
For those not using cloudflare but who have access to web server config files and want to block AI bots, I put together a set of prebuilt configs[0] (for Apache, Nginx, Lighttpd, and Caddy) that will block most AI bots from scraping content
3.
Blocking AI from Scraping Your Content(blog.ichi.do)
2 points by anthonyhn 2y ago|0 comments
4.
by anthonyhn 2y ago
> search engine such an easy thing to produce? Yes, I run my own independent search engine[0]. > successful Now that's the challenging part, especially since Mozilla needs to fund browser development. The initial differentiation
5.
Show HN: AI / LLM bot blocker web server configs(github.com)
2 points by anthonyhn 2y ago|0 comments
6.
by anthonyhn 3y ago
>The biggest issue is that an ancient version of Firefox is the only viable option for a web browser. There was some work done on porting Palemoon, Otter Browser, and QtWebEngine to ArcaOS. A preview version of a QtWebEngine-based browse
7.
by anthonyhn 3y ago
> But I always find I have nothing to speak about. Odds are you do have something interesting to speak about. Many people are experts in very niche things and don't even realize it. You may be very proficient with a niche piece of s
8.
by anthonyhn 3y ago
>Wish I had an invite. They have an IRC chat room where you can request an invite[0]. They typically ask if you have a personal website, git repo, interesting projects, etc when inviting people. [0] https://lobste.rs/chat
9.
Show HN: Ichido Metaverse Search, a search engine for WebVR pages(metaverse.ichi.do)
2 points by anthonyhn 3y ago|0 comments
10.
by anthonyhn 3y ago
Lisp has very minimal syntax and so you can build a lisp interpreter fairly easily in many languages. Most languages don't have a readily available python interpreter that you can embed, and building one that is feature parity with CPy
11.
by anthonyhn 3y ago
Wikipedia has a page on single-user personal wikis that are great for organizing your notes[0]. If you're looking for something simple and unixy, Zim is a pretty good choice[1]. It's an offline GTK-based GUI application for creati
12.
by anthonyhn 3y ago
Yes, it can be quite frustrating. On my search engine[0] I tag sites that use captcha services and browser checks so that the user has more transparency and can choose to avoid sites that use these services if they want. [0] https:/&#
13.
by anthonyhn 3y ago
I work on a search engine in my spare time as a side project. What I've learned from working on a search engine is that even though the recent GPT models are quite good for general purpose search, there are still ample opportunities in
14.
by anthonyhn 3y ago
If you don't mind me asking, what do you use Haskell for at work? Also was the company using Haskell before, or did you bring Haskell to the job? It's always fascinating hearing stories about people using less common languages lik
15.
by anthonyhn 3y ago
GNU Parallel is pretty useful. You can use it to run command line programs in parallel. For example, if you wanted to gzip compress all individual files in a directory and limit the number of jobs equal to the number of CPU cores on your ma
16.
by anthonyhn 3y ago
Just haven't tested it out yet, but am interested in testing out some different plugins and combinations in the future. Also neovim wasn't available in one of the platforms I use, so have been sticking with vim.
17.
by anthonyhn 3y ago
I use vim for C++ coding, however it is a bit difficult to set up to make it productive. I use YouCompleteMe [0] for autocompletion, Vimspector [1] with the C++ plugin for debugging, ALE [2] for linting, along with a few other general plugi
18.
by anthonyhn 3y ago
The Palemoon browser [0] also still uses XUL, and is in many ways a continuation of XUL browsers (was originally forked from FF 29, updated with various components from FF 50+, and with many other tweaks). [0] https://palemoon.or
19.
by anthonyhn 4y ago
For offline/local TTS, Coqui TTS [0] is quite good. It's essentially a continuation of Mozilla's TTS engine that Mozilla stopped working on ~2 years ago (and IIRC it's largely the same team that worked on Mozilla TTS). [
20.
by anthonyhn 4y ago
Alpine Linux is also pretty relevant in the container space due to its small base image size. If you look at the downloads on Docker Hub [0], Alpine Linux, Ubuntu, Debian, and CentOS (although CentOS was deprecated by Red Hat) all have 1 bi
21.
by anthonyhn 4y ago
You can disable some of firefox's background network requests by modifying the about:config key/value pairs of your firefox profile (for example, by using a user.js file). The Arkenfox user.js ( https://github.com/a
22.
by anthonyhn 4y ago
I typically use mypy. It's been around for over a decade, is available in many package repos, and has pretty good integration with vim lint plugins such as ALE ( https://github.com/dense-analysis/ale ).
23.
by anthonyhn 4y ago
> I see you offer an opensearch.xml already - if you embed it as link node with the appropriate type it will be straightforward to add it to the browser as (default) search engine Thanks for the heads up, I used to have a <link rel=&q
24.
by anthonyhn 4y ago
>Is it easy for you to rely on more search index providers, what are your options? I have a few options: * Switch index providers. For example, Mojeek has an index with 6bn pages and has a web search API; may be more sustainable to switc
25.
by anthonyhn 4y ago
EDIT: I found some of the pages with links that include UTM tracking params. Let me know if you want me to send you the pages with those links, can send them through email (my email is on the contact page of the site).
26.
by anthonyhn 4y ago
> what's wrong with webp? Nothing wrong with the format in particular. However some may prefer formats such as PNG and JPEG since: * A lot more software supports PNG and JPEG (backwards compatibility, better integration with one&#x2
27.
by anthonyhn 4y ago
Since spacehey includes user-submitted content, it's possible that: * Someone uploaded a WEBP image to the site. * Someone pasted a link with a utm_* param. * The page was crawled when cloudflare was used. Will look into it and see if
28.
by anthonyhn 4y ago
>Just added Ichido. Thanks, much appreciated
29.
by anthonyhn 4y ago
It's $4/1000 queries, but the rate is increasing in May to $18/1000 queries. The Bing API is available through Azure.
30.
by anthonyhn 4y ago
>Edit: looks like the file type filter is dropped as well. Do add the arguments to the pagination links. Thank you, great feedback! You're right, I forgot to include some of the params in the pagination, will have to include those i

More ›