7 ms·

Question for the experts! Has NTFS changed much in... 20 years? Linux filesystems seem to be evolving all the time (try to install any new distro today and ch

Question for the experts! Has NTFS changed much in... 20 years? Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) Apple replaced one filesystem with another in just the past few years, with apparently some very advanced new features. But NTFS is just... NTFS? Does NTFS today look anything like how it looked in 1994? Or 2018? Does it change radically between versions of Windows? Or does the MS creed of compatibility at all costs mean it's basically a filesystem unchanged from the 90s? Thanks!

MuffinFlavored 3y ago
> Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) This sounds like evolution of options more than evolution of existing file systems Is ext4 still not most popular for most end users? Curious how much ext4 has changed vs NTFS past... ~20 years (ext4 went stable 2008 apparently)
- Cu3PO42 3y ago
  ext4 remains the default for a lot of distros and probably most end users, but other options are common as well. openSUSE and Fedora now default to btrfs, RHEL defaults to XFS.
  - loeg 3y ago
    XFS also has not changed much in the past 10-20 years :-).
    - yjftsjthsd-h 3y ago
      https://en.wikipedia.org/wiki/XFS https://en.wikipedia.org/wiki/XFS lists what I would call significant improvements, in particular, > Linux kernel 4.8 in August 2016 added a new feature, "reverse mapping". This is the foundation for a large set of planned features: snapshots, copy-on-write (COW) data, data deduplication, reflink copies, online data and metadata scrubbing, highly accurate reporting of data loss or bad sectors, and significantly improved reconstruction of damaged or corrupted filesystems. This work required changes to XFS's on-disk format.
    - keep_reading 3y ago
      Wow you've missed so much. It's gone from "only fast with huge files" to being one of the most performant and capable filesystems in existence
- distract8901 3y ago
  My bet is that btrfs will replace ext4 in the nearish future. It's the default for Arch, which also comes default with filesystem snapshots before any system updates. It's pretty nice. I think it also supports some flavor of volumes or virtual partitions, but I don't have any real use for that kind of thing. The snapshots are really good though. Very fast and don't take up a ton of space, somehow.
  - kcb 3y ago
    Never using btrfs no matter how default it comes. Only filesystem I've had data loss with, 2 district occasions.
    - hardwaresofton 3y ago
      Would you mind noting how recent the data loss was?
      - kcb 3y ago
        Latest in the past year or so. All long after it was "stable".
        hardwaresofton 3y ago
        Appreciate it. As someone who basically continues to use ZFS happily and didn't kick the tires because of the stability & ergonomics issues in the past, this is concerning to hear... Looks like kicking the tires will remain somewhat in the future for me.
        v3ss0n 3y ago
        It's much stable after 6.4 kernel. Last year was not really stable yet. I faced too, problem is I didn't know we have to schedule a `btrfs scrub`. After kernel update and scrub, everything works smooth.
    - Chmouel 3y ago
      I recently had a bit of a data hiccup on my desktop laptop, where I'm using Btrfs with LVM encryption. What's weird is that I started getting these random reboots out of the blue, with no error messages to explain what was going on. I was scratching my head for a while, thinking it might be a hardware issue. Then, in frustration, I rebooted into my Windows partition, which I rarely ever use. to see if I could back up my stuff and figure out why I wasn't having the same reboot problems in Windows. After trying a bunch of Btrfs repair commands over a bootable usb disk I found online, I hit a wall with some errors that couldn't be fixed. So, I threw in the towel and reinstalled my system with ext4. It's been running smoothly for three weeks now with no more error headaches. Could not find the logs of the errors anymore unfortunately to report.
- toyg 3y ago
  Btrfs seems to be the new standard, it might well end up being the one big thing Oracle did for Linux; it definitely evolved significantly over the last 15 years.
- rsaxvc 3y ago
  Ext4 has changed their binary format twice with only forward compatibility. Mounting a new, large ext4 partition often won't work on old machines. Source: had to patch yaboot(PowerPC Mac bootloader) to update ext4 to boot with /boot on ext4.
- fulafel 3y ago
  ext2/3/4 are the same on-disk filesystem with features added, so could also compare the timeline from the 90's. NTFS and ext2 have the same year (1993) listed on WP as intro date.
naikrovek 3y ago
NTFS has gained support for a few features over the years, but it wasn't meant to evolve, much. Microsoft knew what they wanted from the filesystem and they wrote it to spec very early in its life. ReFS on Windows is where the changes are coming to. finally a 1st party filesystem which supports Copy on Write file cloning. a lot of core features of NTFS aren't supported on ReFS, so it's clearly not intended to be a replacement for NTFS.
- babypuncher 3y ago
  Windows recently got support for booting from ReFS volumes, so it seems like Microsoft has started working on it again and maybe does think a move away from NTFS is possible in the future.
  - naikrovek 3y ago
    until ReFS supports compression, encryption, quotas, OneDrive support, and whatever else is missing, NTFS isn't going anywhere. they're gonna live side by side for 30+ years. they are meant for different uses.
- chiph 3y ago
  The recent interview with Dave Cutler mentioned this briefly. When the Cairo team was working on their object file system, they had no requirement to maintain backwards compatibility (which makes sense for new development). But they didn't build in a way to have in-place upgrades after it would have been released, either. The Tukwila team, still working with the old codebase, had a rule that NTFS could be upgraded, but it had to either accept the old file system structures, or be upgraded in-place. And their code allowed for that. Relevant portion starts at about 2:10 https://www.youtube.com/watch?v=xsQBKkPj5Nc https://www.youtube.com/watch?v=xsQBKkPj5Nc
mc32 3y ago
There’s ReFS for windows. Don’t forget Apple was stuck with one barely functioning FS (HFS+) for decades.
- denkmoon 3y ago
  Is ReFS real? Like does anyone really use it outside of Microsoft's labs?
  - electroly 3y ago
    The Windows 11 feature "Dev Drive" uses ReFS. https://learn.microsoft.com/en-us/windows/dev-drive/ https://learn.microsoft.com/en-us/windows/dev-drive/
    - denkmoon 3y ago
      Pretty cool, I'd never seen that before. Thanks
gecko 3y ago
It hasn't changed radically, but it has changed. Wikipedia actually has a nice write-up if you want the details, but support for symbolic links, transactions, and partition resizing are all things that have materially improved my life in the last ~5-10 years.
- electroly 3y ago
  All of those features are over 10 years old. Time moves fast. Windows 7 was 14 years ago.
  - Arrath 3y ago
    > Windows 7 was 14 years ago. Surely you lie..
    - m-p-3 3y ago
      And here I am, still trying to rid the corporation from Office 2010 from some users..
- nyanpasu64 3y ago
  Unfortunately(?), Transactional NTFS is deprecated and Microsoft claims it may not be available in future versions of Windows.
m463 3y ago
linux ntfs support seems sort of hit or miss. For example, I have a dual-boot arch/win system with 2 ntfs partitions and a with a recent update the linux kernel ntfs driver can't mount the filesystems, have to fall back to the fuse implementation. It also didn't seem to be able to do things like set system flags hsra, but I found a way with the fuse implementation.

MuffinFlavored 3y ago

> Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) This sounds like evolution of options more than evolution of existing file systems Is ext4 still not most popular for most end users? Curious how much ext4 has changed vs NTFS past... ~20 years (ext4 went stable 2008 apparently)

Cu3PO42 3y ago
ext4 remains the default for a lot of distros and probably most end users, but other options are common as well. openSUSE and Fedora now default to btrfs, RHEL defaults to XFS.
- loeg 3y ago
  XFS also has not changed much in the past 10-20 years :-).
  - yjftsjthsd-h 3y ago
    https://en.wikipedia.org/wiki/XFS https://en.wikipedia.org/wiki/XFS lists what I would call significant improvements, in particular, > Linux kernel 4.8 in August 2016 added a new feature, "reverse mapping". This is the foundation for a large set of planned features: snapshots, copy-on-write (COW) data, data deduplication, reflink copies, online data and metadata scrubbing, highly accurate reporting of data loss or bad sectors, and significantly improved reconstruction of damaged or corrupted filesystems. This work required changes to XFS's on-disk format.
  - keep_reading 3y ago
    Wow you've missed so much. It's gone from "only fast with huge files" to being one of the most performant and capable filesystems in existence
distract8901 3y ago
My bet is that btrfs will replace ext4 in the nearish future. It's the default for Arch, which also comes default with filesystem snapshots before any system updates. It's pretty nice. I think it also supports some flavor of volumes or virtual partitions, but I don't have any real use for that kind of thing. The snapshots are really good though. Very fast and don't take up a ton of space, somehow.
- kcb 3y ago
  Never using btrfs no matter how default it comes. Only filesystem I've had data loss with, 2 district occasions.
  - hardwaresofton 3y ago
    Would you mind noting how recent the data loss was?
    - kcb 3y ago
      Latest in the past year or so. All long after it was "stable".
      - hardwaresofton 3y ago
        Appreciate it. As someone who basically continues to use ZFS happily and didn't kick the tires because of the stability & ergonomics issues in the past, this is concerning to hear... Looks like kicking the tires will remain somewhat in the future for me.
      - v3ss0n 3y ago
        It's much stable after 6.4 kernel. Last year was not really stable yet. I faced too, problem is I didn't know we have to schedule a `btrfs scrub`. After kernel update and scrub, everything works smooth.
  - Chmouel 3y ago
    I recently had a bit of a data hiccup on my desktop laptop, where I'm using Btrfs with LVM encryption. What's weird is that I started getting these random reboots out of the blue, with no error messages to explain what was going on. I was scratching my head for a while, thinking it might be a hardware issue. Then, in frustration, I rebooted into my Windows partition, which I rarely ever use. to see if I could back up my stuff and figure out why I wasn't having the same reboot problems in Windows. After trying a bunch of Btrfs repair commands over a bootable usb disk I found online, I hit a wall with some errors that couldn't be fixed. So, I threw in the towel and reinstalled my system with ext4. It's been running smoothly for three weeks now with no more error headaches. Could not find the logs of the errors anymore unfortunately to report.
toyg 3y ago
Btrfs seems to be the new standard, it might well end up being the one big thing Oracle did for Linux; it definitely evolved significantly over the last 15 years.
rsaxvc 3y ago
Ext4 has changed their binary format twice with only forward compatibility. Mounting a new, large ext4 partition often won't work on old machines. Source: had to patch yaboot(PowerPC Mac bootloader) to update ext4 to boot with /boot on ext4.
fulafel 3y ago
ext2/3/4 are the same on-disk filesystem with features added, so could also compare the timeline from the 90's. NTFS and ext2 have the same year (1993) listed on WP as intro date.

naikrovek 3y ago

NTFS has gained support for a few features over the years, but it wasn't meant to evolve, much. Microsoft knew what they wanted from the filesystem and they wrote it to spec very early in its life. ReFS on Windows is where the changes are coming to. finally a 1st party filesystem which supports Copy on Write file cloning. a lot of core features of NTFS aren't supported on ReFS, so it's clearly not intended to be a replacement for NTFS.

babypuncher 3y ago
Windows recently got support for booting from ReFS volumes, so it seems like Microsoft has started working on it again and maybe does think a move away from NTFS is possible in the future.
- naikrovek 3y ago
  until ReFS supports compression, encryption, quotas, OneDrive support, and whatever else is missing, NTFS isn't going anywhere. they're gonna live side by side for 30+ years. they are meant for different uses.
chiph 3y ago
The recent interview with Dave Cutler mentioned this briefly. When the Cairo team was working on their object file system, they had no requirement to maintain backwards compatibility (which makes sense for new development). But they didn't build in a way to have in-place upgrades after it would have been released, either. The Tukwila team, still working with the old codebase, had a rule that NTFS could be upgraded, but it had to either accept the old file system structures, or be upgraded in-place. And their code allowed for that. Relevant portion starts at about 2:10 https://www.youtube.com/watch?v=xsQBKkPj5Nc https://www.youtube.com/watch?v=xsQBKkPj5Nc

mc32 3y ago

There’s ReFS for windows. Don’t forget Apple was stuck with one barely functioning FS (HFS+) for decades.

denkmoon 3y ago
Is ReFS real? Like does anyone really use it outside of Microsoft's labs?
- electroly 3y ago
  The Windows 11 feature "Dev Drive" uses ReFS. https://learn.microsoft.com/en-us/windows/dev-drive/ https://learn.microsoft.com/en-us/windows/dev-drive/
  - denkmoon 3y ago
    Pretty cool, I'd never seen that before. Thanks

gecko 3y ago

It hasn't changed radically, but it has changed. Wikipedia actually has a nice write-up if you want the details, but support for symbolic links, transactions, and partition resizing are all things that have materially improved my life in the last ~5-10 years.

electroly 3y ago
All of those features are over 10 years old. Time moves fast. Windows 7 was 14 years ago.
- Arrath 3y ago
  > Windows 7 was 14 years ago. Surely you lie..
  - m-p-3 3y ago
    And here I am, still trying to rid the corporation from Office 2010 from some users..
nyanpasu64 3y ago
Unfortunately(?), Transactional NTFS is deprecated and Microsoft claims it may not be available in future versions of Windows.

m463 3y ago

linux ntfs support seems sort of hit or miss. For example, I have a dual-boot arch/win system with 2 ntfs partitions and a with a recent update the linux kernel ntfs driver can't mount the filesystems, have to fall back to the fuse implementation. It also didn't seem to be able to do things like set system flags hsra, but I found a way with the fuse implementation.