3 ms·
Lovely. Quick question, is this the sort of technique that used for general text diffing? I see you effectively tokenize the string using whitespace to split a
by aidos 10y ago
Lovely.
Quick question, is this the sort of technique that used for general text diffing? I see you effectively tokenize the string using whitespace to split and then pass in 2 lists of tokens. Is that the way it's generally done, and you just choose a suitable tokenizer for your specific use-case?
- paulgb 10y agoUsually for source code, the diff is line-based. I didn't actually have a use case at the time, I just wanted to see if it would work.