4 ms·

> You need to know what to do when copying data from one filesystem to another when the names can't be stored on the destination. You already need to know that

> You need to know what to do when copying data from one filesystem to another when the names can't be stored on the destination. You already need to know that, because filesystems are a jungle. This covers everything from special characters, to non-Unicode encodings, to different Unicode-like encodings, to special names, to file name length limits, and path length limits. Consider that on Linux a filename is just an arbitrary sequence of bytes with some limitations, and on Windows it's an arbitrary sequence of 16-bit integers. You can put unpaired surrogate characters in a Windows path, and you can put 0xff in a Linux path. > I feel it's often better to train the user on how to use a simple system effectively, than to build a complex system. You have to put the complexity somewhere, and humans are easier to change than software and hardware. Filenames are something that affects everyone who uses computers for more than just browsing the web. By and large, these people have been using case-insensitive filesystems for the past 40 years, except the people using Unix-derivatives other than macOS--a small slice of people with a high percentage of experts. So if you have an idea of how to train a billion people to deal with case sensitivity problems that they didn't have to do with before, I'm all ears. And yes... the case folding and locale problems exist. I think we're already on the way to the right solution there... hide the filesystem completely from most people who use computers. The filesystem is a terrible way to organize data, so we are building more complicated filesystems and more complicated stacks on top of filesystems to make it easier for humans to work with, and rightly so.

ChrisSD 6y ago
> Consider that on Linux a filename is just an arbitrary sequence of bytes with some limitations, and on Windows it's an arbitrary sequence of 16-bit integers. You can put unpaired surrogate characters in a Windows path, and you can put 0xff in a Linux path. I don't think these are as equivalent as you imply. While it's technically possible for Windows paths to contain unpaired surrogates, in practice it never happens outside of malicious software (and even that's rare), Whereas on Linux, getting a "random" bag of bytes is relatively common because the convention of UTF-8 is new (and is a userspace convention). Of course it's usually not truly random but you have to play guess the encoding if you want to interpret it.
- klodolph 6y ago
  Not implying anything about equivalence.
toast0 6y ago
> So if you have an idea of how to train a billion people to deal with case sensitivity problems that they didn't have to do with before, I'm all ears. It's a bit harder for the people who had case insensitivity before, I'd imagine. But the basic way to train people for this is a) to work consistently and b) drop helpful examples in places. For a) When someone makes a new directory lowercse dotless i when they already have a folder named I, they might be surprised to have two directories with the same letter, but they'll figure it out. The same way that they figured out news.ycombinator.com/REPLY doesn't work, because the bytes aren't the same. For b) make some tools expect a file called Makefile and not work if makefile is present. Done!
- klodolph 6y ago
  Solving a relatively simple technological problem with an immense human labor is a bad tradeoff. Computers are for end-users. OS and app developers are in the minority, and we should remember that when we write apps or filesystems.
  - toast0 6y ago
    Anything involving Unicode (or pre-unicode encoding) isn't a relatively simple technological problem.
    - klodolph 6y ago
      That's a bit pessimistic--displaying plain, unstyled text onscreen is significantly more difficult, and yet we expect computers to figure it out automatically. You don't have to position each character by hand or select the right glyph. You can just click in a text box and start typing. Case folding and collation are far easier problems by comparison.

ChrisSD 6y ago

> Consider that on Linux a filename is just an arbitrary sequence of bytes with some limitations, and on Windows it's an arbitrary sequence of 16-bit integers. You can put unpaired surrogate characters in a Windows path, and you can put 0xff in a Linux path. I don't think these are as equivalent as you imply. While it's technically possible for Windows paths to contain unpaired surrogates, in practice it never happens outside of malicious software (and even that's rare), Whereas on Linux, getting a "random" bag of bytes is relatively common because the convention of UTF-8 is new (and is a userspace convention). Of course it's usually not truly random but you have to play guess the encoding if you want to interpret it.

klodolph 6y ago
Not implying anything about equivalence.

toast0 6y ago

> So if you have an idea of how to train a billion people to deal with case sensitivity problems that they didn't have to do with before, I'm all ears. It's a bit harder for the people who had case insensitivity before, I'd imagine. But the basic way to train people for this is a) to work consistently and b) drop helpful examples in places. For a) When someone makes a new directory lowercse dotless i when they already have a folder named I, they might be surprised to have two directories with the same letter, but they'll figure it out. The same way that they figured out news.ycombinator.com/REPLY doesn't work, because the bytes aren't the same. For b) make some tools expect a file called Makefile and not work if makefile is present. Done!

klodolph 6y ago
Solving a relatively simple technological problem with an immense human labor is a bad tradeoff. Computers are for end-users. OS and app developers are in the minority, and we should remember that when we write apps or filesystems.
- toast0 6y ago
  Anything involving Unicode (or pre-unicode encoding) isn't a relatively simple technological problem.
  - klodolph 6y ago
    That's a bit pessimistic--displaying plain, unstyled text onscreen is significantly more difficult, and yet we expect computers to figure it out automatically. You don't have to position each character by hand or select the right glyph. You can just click in a text box and start typing. Case folding and collation are far easier problems by comparison.