5 ms·
If it's that trivial to find them (with code, not eyeballs), it's also trivial to remove them.
by blep_ 4y ago
If it's that trivial to find them (with code, not eyeballs), it's also trivial to remove them.
- Scoundreller 4y agoor paste into notepad.exe, copy back into whatever you were using. Voila!
- telotortium 4y agoThat will almost certainly preserve the invisible characters. Most invisible characters are used for some kind of in-line formatting in Unicode, so it's not desirable to remove them.
- Scoundreller 4y agoWhat inline formatting in notepad.exe? It doesn't even support bolding/italics/underling. But I guess there are tabs and line return/carriage returns, so there's that.
- trifurcate 4y agoRight-to-left/left-to-right markers. Language tags. Various invisible spaces. Homoglyphs. (all trivially filterable though)
- dotancohen 4y agoI've already got a script running every 2500 milliseconds to strip leading and trailing whitespace, HTML, and non-ASCII characters except for the UTF-8 characters of our local language.
- ZephyrBlu 4y agoI assume most people would not be that sophisticated, but I understand the point. This seems like it would be an ongoing battle no matter what OpenAI does though.