dreamforever

10 ms·

1.
by dreamforever 2mo ago
it was by no means low effort
2.
by dreamforever 2mo ago
I'll check them out!
3.
by dreamforever 2mo ago
despite this limitation, there is still some good stuff out there, and with the priority steering, you can focus compute on what you actually want, fast and cheap.
4.
by dreamforever 2mo ago
There are all kinds of websites in here lol. There is some gold in here and I'm determined to surface it all. I had to wrap this up without full analysis cos it was dragging on
5.
by dreamforever 2mo ago
Ah, I forgot to mention that anywhere. You have to provide your own. You can start from a small set, like 10 websites you like that have a bit of character, and it will also add any domains it finds from those 10
6.
by dreamforever 2mo ago
It's not for that, sorry, I should have been more specific. It's for people who wanna put in the effort and steer their own crawl to surface their own slice of the web. The article is just a little story of the journey
7.
I built a 500k-domain search engine for makers in a weekend for $10(alexmorleyfinch.github.io)
142 points by dreamforever 2mo ago|86 comments
8.
by dreamforever 2mo ago
Check out my latest project! You can fork it, tweak the policy manually or with AI, run the system and watch the data come in! It's engineered to keep a low data footprint, so 500k domains fits into 1GB on disk. If you have local model
9.
A representation model as a workaround for catastrophic forgetting in LLMs(gist.github.com)
3 points by dreamforever 5mo ago|0 comments