3 ms·
System Design for Entity Resolution
- PaulHoule 2y agoThis is what the analysis was 10 years ago. What has changed?
- rkwz 2y agoData still needs to be cleaned ;) ML based linkage has evolved a lot over the past years, and a few people are trying out LLM based ones - https://arxiv.org/pdf/2403.06434v1 https://arxiv.org/pdf/2403.06434v1
- PaulHoule 2y agoI'd assume you could train a cross encoder network like https://sbert.net/docs/cross_encoder/usage/usage.html https://sbert.net/docs/cross_encoder/usage/usage.html to "predict" if two entities are the same?