4 ms·
While out of scope to the post somewhat, with validating utf-8 it'd be great to know of a standard way to toss out special characters like the vertical ones tha
by devwastaken 8y ago
While out of scope to the post somewhat, with validating utf-8 it'd be great to know of a standard way to toss out special characters like the vertical ones that can be used to interrupt page content. Seems most places just never filter it. Even back in Neverwinter nights I believe you could do some fun names.
- ubernostrum 8y agoSo validate the stream first, then apply your exclusion logic afterward (until you validate, you wouldn't have any way of knowing if you're excluding the right things, because you wouldn't yet know if you're even working with UTF-8).
- carlmr 8y agoYeah, this is the previous step.
- cmyr 8y agoT̙̙̳̠͕h̩͍̣̗͇̙e̖̙͇̺͍̝̙r̭̦̭̗̯͓͍̘e̮̜̼̝'̬͕̦̭̠s͖͎ ̙͎̫̭ͅa̲͖͙̟̹͚̱̜l̮͇w̥̙͙͎͍̻a͇̦̤̭̫̼͍͔y͖̰̱̣͉̗̼̟̘s̲͇̼̻̻͍͉ ̠̞̦̲̝̱̗o̪n͈͎̞e̥͈̠̬͍̬̱̲ ̪̼̝̞̮g̥ṵ͈̥y͎̤͖̥ ̜̬ṯ̳̗̜̼̱̬r̠̫̪̺̫y̗͍͔̜͇͍ị̼̲n̖̥͙͓̹̘̞̳͕g͕̗ͅ ̪t̤o̰̞̱͓̫̙̙͔͕ ͍r̟u̺͈̞͚͖i͖͈̗̭͖̯n͈̼̜̹ ͙̙̪̰̫̼͓i̻̩̰̪t̤̦̖͉ ͇̳̰f͔̥͕̟̝o͉̬r̥͕̝̬̰ ̟̪͇̺͉̰̭ḛ̙͕͕̜v͚ͅe̥͈̰̮̭̼ṟ̥͔͎̯̖y̤̞̮̳̪̞̰o͖̱͙͖̜̦n̙̦e̘̰͉͓̫̥̞ ̩e͖͕ḽ̭̪͚͕ͅs̮̺̣̬͍ḙ̬̫̹̻̤͖̗.͎
- kevingadd 8y agoKeep in mind those characters largely exist to allow people to write in their native languages, so you need to make sure your filter doesn't stop them from expressing themselves.
- VMG 8y agoThere are always trade-offs. Even written language is a constraint by itself.