3 ms·

In fairness, it's probably impossible to unambiguously determine what the intended/desired interpretation is (though intuitively it seems like k-means should be

In fairness, it's probably impossible to unambiguously determine what the intended/desired interpretation is (though intuitively it seems like k-means should be lower likelihood)!

avereveard 2y ago
I've tried Hyde and seems to work better. had to do it client side tho. asked chatgpt: "write one sentence explanation about this topic: solutions for postgres clustering" which returned "Solutions for PostgreSQL clustering involve implementing methods such as streaming replication or third-party tools like Patroni to manage and distribute database workloads across multiple servers for enhanced performance and fault tolerance." then I searched that: https://hackersearch.net/search?q=Solutions+for+PostgreSQL+clustering+involve+implementing+methods+such+as+streaming+replication+or+third-party+tools+like+Patroni+to+manage+and+distribute+database+workloads+across+multiple+servers+for+enhanced+performance+and+fault+tolerance.&period=last-3-years https://hackersearch.net/search?q=Solutions+for+PostgreSQL+c... and results are much better: 1. An overview of distributed Postgres architectures 2. A Technical Dive into PostgreSQL's replication mechanisms 3. Ways to capture changes in Postgres hyde paper is here https://arxiv.org/abs/2212.10496 https://arxiv.org/abs/2212.10496 it's possible that openai embedding are simmetrical, if that the case you need to hallucinate some content and use that as base for the embedding distance calculation. or you can move to asymmetric embedding, or you can try prompting their embedding edit: prompting embedding seems to work, tried searching for “write an article about: solutions for postgres clustering” and results are much better https://hackersearch.net/search?q=write+an+article+about%3A+solutions+for+postgres+clustering&period=last-3-years https://hackersearch.net/search?q=write+an+article+about%3A+... you can try prepending "write an article about: " to all user searches :D
- jnnnthnn 2y ago
  Sweet! Thanks for sharing. A prior implementation had HyDE running on user searches, but I found the results to be hit-or-miss depending on the query type. I definitely want to re-explore that though; I think it should be possible to do so a lot more rigorously now that I have a better sense for what people want to search for.
  - jnnnthnn 2y ago
    Relatedly, the "Follow up queries" in the righthand floating insert are an attempt at finding a decent balance between recovering from failures & giving users enough control on the queries themselves :) See https://hackersearch.net/search?q=postgres+clustering&period=last-3-years https://hackersearch.net/search?q=postgres+clustering&period...
    - avereveard 2y ago
      you should really use this visibility to get a thumbs up / down near each result and use that as a validation set :D
      - jnnnthnn 2y ago
        Totally! I've come to deeply dislike thumbs up/down UXes, so I'm collecting that by recording clicks on results!

In fairness, it's probably impossible to unambiguously determine what the intended/desired interpretation is (though intuitively it seems like k-means should be lower likelihood)!

avereveard 2y ago

I've tried Hyde and seems to work better. had to do it client side tho. asked chatgpt: "write one sentence explanation about this topic: solutions for postgres clustering" which returned "Solutions for PostgreSQL clustering involve implementing methods such as streaming replication or third-party tools like Patroni to manage and distribute database workloads across multiple servers for enhanced performance and fault tolerance." then I searched that: https://hackersearch.net/search?q=Solutions+for+PostgreSQL+clustering+involve+implementing+methods+such+as+streaming+replication+or+third-party+tools+like+Patroni+to+manage+and+distribute+database+workloads+across+multiple+servers+for+enhanced+performance+and+fault+tolerance.&period=last-3-years https://hackersearch.net/search?q=Solutions+for+PostgreSQL+c... and results are much better: 1. An overview of distributed Postgres architectures 2. A Technical Dive into PostgreSQL's replication mechanisms 3. Ways to capture changes in Postgres hyde paper is here https://arxiv.org/abs/2212.10496 https://arxiv.org/abs/2212.10496 it's possible that openai embedding are simmetrical, if that the case you need to hallucinate some content and use that as base for the embedding distance calculation. or you can move to asymmetric embedding, or you can try prompting their embedding edit: prompting embedding seems to work, tried searching for “write an article about: solutions for postgres clustering” and results are much better https://hackersearch.net/search?q=write+an+article+about%3A+solutions+for+postgres+clustering&period=last-3-years https://hackersearch.net/search?q=write+an+article+about%3A+... you can try prepending "write an article about: " to all user searches :D

jnnnthnn 2y ago
Sweet! Thanks for sharing. A prior implementation had HyDE running on user searches, but I found the results to be hit-or-miss depending on the query type. I definitely want to re-explore that though; I think it should be possible to do so a lot more rigorously now that I have a better sense for what people want to search for.
- jnnnthnn 2y ago
  Relatedly, the "Follow up queries" in the righthand floating insert are an attempt at finding a decent balance between recovering from failures & giving users enough control on the queries themselves :) See https://hackersearch.net/search?q=postgres+clustering&period=last-3-years https://hackersearch.net/search?q=postgres+clustering&period...
  - avereveard 2y ago
    you should really use this visibility to get a thumbs up / down near each result and use that as a validation set :D
    - jnnnthnn 2y ago
      Totally! I've come to deeply dislike thumbs up/down UXes, so I'm collecting that by recording clicks on results!