3 ms·
Are you saying that you don't think that embedding retrieval would work well for this kind of problem or are you saying that you doubt that the UK gov will be d
by sgt101 3y ago
Are you saying that you don't think that embedding retrieval would work well for this kind of problem or are you saying that you doubt that the UK gov will be doing this kind of thing.
BTW - I used to do lots of clustering and analysis on freeform text, but first SVD and then embeddings have just changed the game so much that it's the starting point now.
- IanCal 3y agoThat the UK gov will be doing that, certainly from the descriptions in the article - though perhaps I've misunderstood what you meant. If it's "backend tool to more easily find relevant sources" rather than what I originally thought which was "automated FOI responses with minimal/no human oversight" then I could see that more. The examples in the article were a backend tool for searching hansard and one for what sounds like clustering and summarising consultation responses. I think the latter was misunderstood by the author of the submission to mean responding to citizens rather than processing citizen responses. > BTW - I used to do lots of clustering and analysis on freeform text, but first SVD and then embeddings have just changed the game so much that it's the starting point now. I agree, also with things like naming clusters and summarising what a cluster is about is a huge improvement IMO to results.