3 ms·
I think this could be a really useful idea, though it's pretty rough around the edges right now. I noticed the related project results quality was much lower th
by luke-stanley 2y ago
I think this could be a really useful idea, though it's pretty rough around the edges right now. I noticed the related project results quality was much lower than I expected, very `noisy`.
Perhaps related projects could be populated with hybrid search and RAG?
E.g: using high quality embeddings (from all metadata you can fit in the embedding context window, names, descriptions, tags etc), and text search.
You could explore the validity of different possible matches with very few tokens using a cheap model like GPT-4o-mini or Llama 3.1-8B (from a number or providers), this could even be done in parallel for each result item.
It might even be worth fine-tuning an embedding model.
Understanding the topic space, and what relate projects are in it is really well would make it much more useful.
Submission should not be needed for projects that are already on GitHub or GitLab. Crawling search APIs to search for related projects ahead of time, or on demand might make sense, if GitHub don't have a topic API that matches their site's shown results, you might need to scrape, or use a third-party search API.