18 ms·
The time has come to replace file systems
- cratermoon 5y agoThe hierarchical folders-and-files metaphor/implementation is second on my list of software paradigms that need to die. And I say that as an "if it ain't broke, don't fix it" guy who does not jump on bandwagons and want to replace everything every other season with the new new thing.
- sacrosancty 5y agoWhy? Hierarchies seem like a natural fit for the human mind. We can know only the relevant parts, which might change according to what we're working on and confidently exclude entire large complex branches like the contents of C:\Windows or some program's temporary working files or whatever from our awareness. They also combine in an obvious way. If you mount another filesystem somewhere, it's contained in that somewhere, not mixed in with the existing one in some unexpected complex way. They're not a natural fit for real world data, but there's a tradeoff between serving humans and serving nature.
- jcims 5y agoIf hierarchies were adequate we wouldn’t have tags or symbolic links/shortcuts.
- cratermoon 5y ago> Hierarchies seem like a natural fit for the human mind I'd argue they only seem that way because we've been raised and taught to use them but haven't been taught sufficiently to think about other ways to organize knowledge. > They're not a natural fit for real world data In "A City is not a Tree"[1], Christopher Alexander discusses the semilattice in relation to city planning and human societies. Clay Shirky has previously noted[2] that categories and ontologies are too brittle to serve human thinking. As an example of an ongoing attempt to create a hierarchical ontology that isn't helpful, look at any list of music genres. Also note that social networks are not organized hierarchically – humans have the ability to handle interconnected structures just fine. This also relates to why many people don't understand or can't quite relate to true distributed peer-to-peer computing or systems where there is no central controller or fail to grasp emergent behavior. But nature is fine with completely decentralized systems: see, for example, foraging ants. See, for example, Emergence: The Connected Lives of Ants, Brains, Cities, and Software by Steven Johnson 1. https://blogs.ischool.berkeley.edu/i103su12/files/2011/07/1965-City-is-not-a-Tree-Alexander.pdf https://blogs.ischool.berkeley.edu/i103su12/files/2011/07/19... 2. https://oc.ac.ge/file.php/16/_1_Shirky_2005_Ontology_is_Overrated.pdf https://oc.ac.ge/file.php/16/_1_Shirky_2005_Ontology_is_Over...
- UltraViolence 5y agoWhat's wrong with adding metadata to each file and indexing that? I thought this was essentially a solved problem. Also, the OP solution merely sounds like a slightly altered filesystem. I thought he was going to propose something akin to WinFS, Microsoft's ploy to merge an SQL database with a filesystem, but it turned out to be a dud.
- theamk 5y agoThe tag-based location of user documents is nice, but why do people want to put it into filesystem layer? This seems like a bad fit. - Tags in filesystem index too much. For example, if there is a program directory which happened to contain a .jpeg file, it should not be shown to user. Neither should user see files from browser's cache folder. - Tags in filesystem index too little. Filesystems are device-specific, and a lot of times, you want to index across all devices in system. And maybe some files have no associated device at all, because they were transparently offloaded to cloud? I think a much better fix would be to have an index database as a separate file, and filesystem providing a general support for it. Author says that the separate indexers might become out of sync or are slow -- but this is not inherent property of indexers, but rather the limitations of the filesystem design. So let's make filesystems more index-friendly: - Make it fast & easy to detect individual file changes: every file has auto-updateable change time that user cannot mess with (linux already does this). Even nicer would be an extra timestamp which updates when content changes (not metadata) -- together with inode, this can detect renames easily and quickly. - Make it fast & easy to detect past filesystem changes: There is a way to quickly find all changes made to the disk since some past moment: Merkle hash of directory + all contents is ideal (like ZFS maintains internally), or failing that, NTFS-style change journals can work too. - Make it fast & easy to detect present filesystem changes: have powerful notification API that can detect all changes on disk. Perhaps also include first few kilobytes written to file for performance (so that file scanners do not have to open every just-written file)? - Make it possible to "claim" subdirectory: something like a common attribute that advices common file browsers to avoid modifying the content. This way a software can use automatically generated names, and not worry about users just copying random files into arbitrary locations of structured hierarchy. (This should be bypassable by user with appropriate warnings -- this is UX mechanism, not security one) - Perhaps a standard on how to store tags? All modern filesystems have attribute support, but AFAIK there is no clear consensus on how exactly it'd store the tags. This way, one could have general tagging system, and winamp music database, and photo management app all looking at the same data and working together.
- syntheweave 5y agoI think most of the friction of filesystems stems from wanting application layer features in a construct that has always been decidedly "systems" and just holds data, while applications themselves have gone the route of appending more and more features into files. Since there's no middle layer, files have increasingly become the Armstrongian "gorilla holding the jungle and a banana", often duplicating state and metadata to get the job done. And it terrifies me when development tools, as they so often do these days, spray around files, because it usually results in broken dependencies somewhere down the line. Another approach that could get at addressing this is to define frontend protocols to filesystems that do targeted, application-y things. This is done in informal vernacular often enough through things like naming conventions, but what we could really aim for is a specification that's a "form-filler" for each category, that consumes various document and data types and produces the desired kinds of metadata. The difference between that and doing it as an indexer is that it could be seen in a bidirectional intermediation sense: if the protocol understands all the relevant formats well enough to parse them, it doesn't have to also hold a file, it could simply use internal structures and generate the file representation on demand if needed. But to do it properly these structures would have to have similar security and integrity guarantees to our current filesystems. And exposing a frontend like this does add surface area, with the silver lining of "if it's pushed down the stack, then fewer application coders will have to roll their own terrible version of this functionality".
- mdoms 5y ago
- perryizgr8 5y agoThis post is full of interesting new ideas. I'd love to see these implemented in a mainstream Linux distro (or Windows/Mac), but the backward compatibility considerations are a huge impediment. Literally all the software in the past 4 decades (at least) has used directory and file based file systems. One way to encourage usage and let developers find advantages of the new system could be to offer this as an alternative file system that can be used in parallel with existing ones. That would also uncover bugs/problems in the new system which could be fixed. PS: I do think the name "didget" could be improved. It is not as natural to write or speak as "file".
- theamk 5y agoIs it really full of new ideas? This looks like a fairly generic tagging system which seems to pop up on HN every few months. If you are interesting in tagging systems, I recommend you to look at Microsoft WinFS (part of Longhorn). This took idea of tags very deeply -- not only it had user-specified tags, but it would parse many existing file formats and automatically generate tags based on contents -- for example, if it saw a word doc and detected it is of "resume" type, it'd extract "Name, Educational Qualification, Experience" values from it. Sadly, there is no good single overview I know of. You can start from wikipedia (https://en.wikipedia.org/wiki/WinFS https://en.wikipedia.org/wiki/WinFS) and follow the links.
- didgetmaster 5y agoI use the name Didget (short for Data Widget) because it encompasses much more than file data. A 'File Didget' is an object where its data stream has unstructured data and is unmanaged by the system. But there are other Didgets (Schema Didgets, Set Didgets, Tag Didgets, etc.) where their data stream contents are completely managed. Like NTFS that uses files for its internal data structures and many databases that use relational tables to manage databases, I chose to enclose all my internal structures (e.g. tags, file tables, allocation bitmaps, etc.) within other Didgets.
- voz_ 5y agoThis person conflates file and file system in some ways that reveal him to be a rank amateur. This is a textbook example of chesterton's fence.
- freddie_mercury 5y agoHis CV says he worked on NFS for Novell for 7 years and then PowerQuest (who made PartitionMagic, DriveCopy, DriveImage, and ServerMagic) for 6 years. He's clearly not a rank amateur.
- BeefWellington 5y agoWhile true it's not impossible for engineers to make mistakes, even experienced senior engineers. I think the mistake here is perhaps the idea that what is proposed are actually problems that need solving. The idea of indexes being managed by the OS is sort of handwaved away in the article because: "they have to store their indexing information in a separate database. It is easy for the database to become out of synchronization with the file system. Also, to speed up the indexing process, users often only index a portion of the file system so using the index might not turn up the file(s) you were looking for." A second mistake is thinking it's possible to solve the "what is this file" problem: The metadata record does not have a file classification system. To determine what is in a file, the file name or the data stream must be examined. This will always be true. You can make a best effort based on some indicators but it will always be prone to problems. What ever system you create that you believe will address this problem will be prone to failures, almost by necessity, because a "type" of a file is largely a philosophical thing that everyone pretends is technical. Even if you solve for 90% of cases, you're still going to have enough problem cases that it won't be reliable. It may work for simpler cases like text files, videos, zip archives, and images. How do you classify a docx though? Is it a zip file? A "document" file? Is something Javascript just because it ends in .js? Is adding this level of overhead to writes useful? You can see in the video his test framework sets up "hundreds of millions" in seconds and yet copying actual live data from his Program Files directory takes 1m10s for 24,431 files. This suggests to me that at the minimum the "hundreds of millions" of objects are not representative of real live data, since that takes approximately 2 seconds to create. I'd also suggest that if this is truly innovative and these problematic things from the presentation are actually just artificial and that it is doing things under the hood, it should be using a true OS filesystem browser to do this same work. To convince me it could replace standard filesystems, demo me an implementation of the OS running on it, or at the very least using it as a storage drive.
- RcouF1uZ4gsC 5y agoI am old enough to remember the talk of Microsoft Cairo (successor to Chicago aka Windows 95) and the Object File System which would do a lot of this. If Microsoft at the heyday of its monopoly power could not pull off something like this, I don’t see it becoming widespread now.
- miffy900 5y agoIt would’ve been really interesting if WinFS actually was released. It had a very interesting type system. Probably would’ve been more suited for servers than desktops/clients.
- didgetmaster 5y agoI wouldn't be surprised if Microsoft could have pulled it off if they had designed the system from the ground up. Instead they tried to do it on the cheap by taking two existing systems (NTFS and SQL Server) and combine them in ways they were never designed to handle. The product was either was too slow or too fragile (or both).
- istillwritecode 5y agoIt's time to wrestle control over files away from users. /S
- sys_64738 5y agoIf you're running Windows then install Everything.
- oliwary 5y agoThis has completely changed the way I use files. I rarely ever open the explorer to navigate to a folder, but instead open everything to search for a file and then instantly jump to the file location. Naming files well becomes much more important than where they are located.
- bitexploder 5y agoSpotlight on mac. I use recoll on my Linux machine and let it update every few days. Fast local file system indexing is amazing and abstracts away a lot of file system pain. You often don't even need to name files particularly well to find what you want if you index file contents as well.
- AceyMan 5y agoFor me, > ls -rec . | ? name -match <substring_in_filename> becomes muscle memory as a pwsh daily driver-type-person (=> PowerShell 7).
- DHowett 5y agoFor simple matches against one pattern, you may prefer... > ls -rec . -filter *substring*` ... as filtering can be offloaded to the "provider" when Get-ChildItem (ls) knows about it. Even if the filesystem provider doesn't handle patterns any differently from Where-Object (?), you can save the cost of hydrating FileInfo objects only to query and discard most of them. For multiple patterns or anything that you'd need a regular expression for, Where-Object is superior!
- AceyMan 5y agoThanks, I'm not usually doing performance required stuff but when I write a function I always want to know the best way to feed the pipeline, I appreciate it. #snoverville
- smitty1e 5y agoIs Didgets a front-end for a SQLite system? Because that would seem a great way to accomplish much of this functionality, with your choice of UX wrapper.
- olliej 5y agoThe idea of building “indexing” into the file system means either the file system directly understands all file types, ignores those it doesn’t understand (thus requiring an out of fs indexer), or requires the file system itself to be able to dynamically load logic to handle different file types. By the time you get to the last one all you’ve done is build spotlight(or the ms equivalent) into your file system, so now you’ve got all the cost of the indexer only now it’s in the process reading and writing the raw bits, and of course doesn’t index contents of any other filesystem (so you’re still going to be running an indexer). I also don’t understand how a filesystem is going to store this data in such a meaningfully different way that it uses less space and/or is faster to index.
- ilaksh 5y agoHis numbered list of issues makes perfect sense. And apparently he has solved all of those problems? This feels like one of those projects that corrects some structural flaws in the status quo.Therefore it should be commended and adopted. However, since the judgement and behavioral patterns of most humans is very similar to that of ruminants, the likely response will be indifference or hostility.
- theamk 5y agoNot sure if you are joking or not, but no, his numbered list of issues does not make a perfect sense. Item 1 is irrelevant -- one very rarely cares about fixed-size metadata record for file, because one doesn't normally cache metadata for each file on filesystem in memory. Items 3 and 1 contradict -- if the file record has an arbitrary number of tags, it cannot be fixed-size. Item 4 is solved by MacOS (via access-via-inode) and Windows (via file tracker service). I cannot quite understand what he means by item 5 but maybe he is talking about Windows not having trusted "ctime" field? If so, this just Windows' problem, all Unixes solved it long time ago. You may want to check the technical merits before recommending the project for adoption.
- Brajeshwar 5y agoI'm sorry, but this sounds like my 13-year old daughter rambling about why her desktop has become complex and why not be just like the simple iPad. However, we may not like it; there will always be a file system - for things to have a location. Yes, we can encapsulate and put a different layer on it -- tags, containers, types, relationships. However, understanding how they (the file system) work would be an immense help. I have been teaching my daughter how files are located, added, size and why these details matter.
- bitexploder 5y agoWell, on the one hand, I tend to agree, but on the other hand, we should explore these concepts more deeply. The Von Neumann computing architecture hasn't changed in like 80 years and is still pretty darn dominant. I am fine with people exploring this space without dismissing them out of hand. Sure, file systems don't seem like they are going anywhere in their present form, but this is how we advance computing. Paradigm shifts can and will happen, eventually.
- vidarh 5y agoTo me, what makes hierarchical file systems compelling, and what a replacement needs to be able to achieve, is that it provides logical filtering. E.g. I rarely want to search all image files on my machine. I want to search screenshots or personal photos or desktop backgrounds. For some categories, like my source code, the hierarchy is deeper. You can emulate that with tags, certainly, and for some things that's a better fit (a photo can be both a personal photo and a desktop background). But what matters is that the full set of operations, including "this is no longer an X, but it's a Y" aka move/rename, and "find Xs with these attributes" must be just as fast and easy to do.
- smasher164 5y agoYou say that like the file system is the ground truth to how we use a disk. It is nothing but another abstraction we've invented to manage blocks on some persistent medium. The vast majority of people wouldn't notice if you replaced their FAT partition with a key-value store, where the keys were paths delimited by slashes (with some UX to traverse paths).
- beardog 5y agoThis looks pretty neat (though i will not easily give up files). The author seems pretty frustrated in another post that few people are interested. I am willing to give it a look over at the design+play with it, but i struggled to even find the website, and on said website there is no way to download the software. I only found a sample data archive. https://didgets.substack.com/p/what-is-wrong-with-you-people?utm_source=url https://didgets.substack.com/p/what-is-wrong-with-you-people...
- theamk 5y agoIn the comments here, people named dozens of similar systems. I am sure that in the previous discussions (that must have prompted that frustrated post) the same happened. Author must have read them.. and then went to write: "I have invented an entirely new way to store and manage all kinds of data" There are no references to other systems, no comparisons. Did he just ignore all the previous work? Having "digets vs X" table and a section why this time it would work will do a great thing to this projects' credibility.
- didgetmaster 5y agoI apologize for the missing download file (DidgetsBeta.zip) on the website www.Didgets.com It seems the latest upload failed, but I fixed it.
- memetomancer 5y agoReading this article left me wondering just where the 200 million tags this guy needs are supposed to come from. Manual curation?! Automatically derived by file extension? file headers? what is the cost of opening a file, parsing its filetype, comparing against a reference, writing it to a database, etc. How is that cheaper than current indexers (which all seem to work fine btw)? I rarely waste effort trying to remember filenames in the first place, much less needing some expensive tag curation to locate files. I simply use a bit of discipline organizing the directory structure(s). If I do ever need to actually search for something, it will be constrained to a narrow subset of directories and ignore the other 199.9 million files or whatever. Moreover, I just don't have the problem of searching for filename fragments to begin with. Nor do I see a reasonable way to use a whole host of powerful unix techniques with a whackadoodle tiny tags filesystem. Or the need to produce a list of 20 million images in 2 seconds. What use would that be anyway? I'm not going to read a list like that - I'm going to operate on it. Please correct me if I'm wrong, but the versatility of `find` is far more powerful if you actually need to handle/sort through that many files, and something like `fzf` probably curtails all these complaints in the first place.
- bombcar 5y agoIt sounds somewhat like “gmail for files” which is … problematic because email search works well enough because it’s relatively rarely done. I suspect a system like this would work, but the tags would eventually be used by many as a way to badly implement a hierarchy.
- Izkata 5y agoKinda like gmail's nested labels. Hierarchies win again.
- celdon25 5y ago> eventually be used by many And that’s the issue. The status quo may be the best choice for the lowest common denominator. But some power users could get much more out of something with a different approach. You can’t force a one-size-fits-all ontology onto the masses. People need to wake up and realize that not all software technologies need to be popular to be successful or useful. It seems people around here assume this without even thinking about it first.
- tartoran 5y agoLet’s replace something that works with an unknown just because time has come is like saying let’s replace transportation with teleporting except that we’re in 2022 and we don’t even know if it’s still possible.
- bombcar 5y agoDidn’t the resource fork for Macs enable some of this stuff decades ago? At least the file still being locatable even if it was moved or renamed.
- lamontcg 5y agoI don't really have any of those problems. And I can rip `find -name` through a 4TB SSD pretty quickly. Usually only a subset is required, because I remember roughly where it is. For my NAS I spend a bit of time on keeping files organized. I don't generally want full-text search either, it tends to be cluttered with crap and I don't use full-text indexers (invariably they seem to decide to reindex whenever I least want them to).
- sumthinprofound 5y agoStill waiting for tabs in WIndows Explorer...
- rashil2000 5y agoYou can use http://qttabbar.wikidot.com http://qttabbar.wikidot.com for native tabs and loads of other useful features. Even works on Windows 11.
- sumthinprofound 5y agoYes I've been using this solution for a few years now it works great with a ton of options.
- Tempest1981 5y ago> The unique identifier for a Didget is a 64 bit number. It remains consistent throughout the life of that Didget. How are safe-saves handled in Didgets? That's usually a case where a unique file-ID gets changed. (Is "safe-save" the canonical name for this? Or atomic-save maybe? Where you save to a new filename, then move that file into place.)
- compressedgas 5y agoIn Windows, when replacing a file with another using ReplaceFile the replacement inherits the original file's NTFS OBJECTID. I would expect that a similar operation would be supported.
- gjvc 5y agosee also https://en.wikipedia.org/wiki/Be_File_System https://en.wikipedia.org/wiki/Be_File_System
- timetraveller26 5y agoThe problem of hierarchical file systems and data location is a really old problem that has had many implementations (I even tried building one many years ago). Somewhat related: Tagsistant https://news.ycombinator.com/item?id=14537650 https://news.ycombinator.com/item?id=14537650 TMSU https://news.ycombinator.com/item?id=11660492 https://news.ycombinator.com/item?id=11660492 BeOS File System https://news.ycombinator.com/item?id=17468920 https://news.ycombinator.com/item?id=17468920 TagSpaces https://news.ycombinator.com/item?id=12679597 https://news.ycombinator.com/item?id=12679597 git-annex https://news.ycombinator.com/item?id=29942796 https://news.ycombinator.com/item?id=29942796 Names should mean what, not where https://dl.acm.org/doi/10.1145/506378.506399 https://dl.acm.org/doi/10.1145/506378.506399 Unfortunaly it's not easy to get a real solution, and many people don't think that there is a problem at all (based on some comments in this thread). Now adays I use git-annex, though it does have it's perks it seems a step in the right direction.
- unqueued 5y agoThe pattern that has worked out really well for me, is to just organize my data into specialized collections, and not worry too much about the underlying filesystem. I can't believe how much trouble I went through trying to find the filesystem that could do everything. I mostly use git-annex, and various tagging systems, or just git repos. Now my data is much more portable and flexible. None of these tools are perfect, but I'm using tools that are mostly good at the job. Whatever problem you are trying to solve, you probably don't need to solve it for your entire filesystem.
- nmlt 5y agoAlso related: https://news.ycombinator.com/item?id=29141800 https://news.ycombinator.com/item?id=29141800 (discussion of differences between hierarchical and tag based file systems)
- zvr 5y agoAlso related (learned this from HN a couple of weeks ago): SuperTag https://amoffat.github.io/supertag/ https://amoffat.github.io/supertag/
- superdisk 5y agoThe pessimism here is ridiculous. I thought the demonstration video was pretty cool, seems like the didgets concept is more sophisticated than meets the eye. Open your mind a little, people.
- morelisp 5y agoSometimes a bad idea comes back from the 1970-90s and people here are on average young enough they start falling for it again. But the last serious shot at this was recent enough and a big enough disaster (Longhorn's WinFS), and/or a few years into iPad ownership when people started wanting to use it as a more serious computing device with an awkward few years until it got "file management" (it always had an FS). Both are too recent. Try again in another 10 years.
- cirrus3 5y agoFirst off, this is clearly just a promotion for "Didgets"... which seems like a cool idea, but the problem is the article presents a solution by framing normal-computer-user file organization as a problem to be solved (it really isn't). OP does this instead of identifying an actual use case. OP - you are losing people this way. Normal users do not have "200 million records" they are trying to search for by file type or name. Get a better pitch than this for whatever you trying to solve. > If you have ever forgotten where you stored a file in a file system Nope, never happened to me. > File systems let you store any file in any folder, regardless of whether the folder path is appropriate for the file YES, exactly, that is a feature, not a problem. If it is not appropriate for the file, you only have yourself to blame for putting it there in the first place. > Even if you remember some parts of the file name > searching by file extension may or may not turn up the file you were looking for Who searches for file by name? Names mean nothing. You find the file by navigating down the relevant hierarchy based on what you are looking for. By file type, are you kidding me? A hierarchical file system is ideal as the basis of file organization. Tags and search can be added on top of that (and admittedly have room for improvement) if you really struggle to handle organizing your files by yourself (or some unstated use case the OP has in mind). I'm struggling to figure out how the OP operates... at some level they seem like a computer illiterate person who saves everything to the desktop then struggles to find stuff. But, I'm sure that is not actually the case... so do they just fail at making an attempt to organize? I'd be interested to better understand what type of files they have so many of that they have to resort to constantly searching by file name or type and need a faster way to do that.
- didgetmaster 5y agoI'm sorry if the article came off as such. I meant to start a discussion about the shortcomings of filesystems and get people to look at possible alternatives. I think what I built (so far) has some great features, but it is entirely possible that the eventual replacement for file systems will be something much different. I spent years working with filesystems and databases and came up with a long list of shortcomings I saw in both. I don't pretend to know all the answers, but I also don't like people dismissing ideas without taking a serious look at them.
- registeredcorn 5y agoI'm always excited to see and learn about new and different concepts, but I struggle with two main points: 1. It is not the implementation of a thing that I worry about, but rather how it will be misused. We have a generally good understanding of how end users misuse the current file system hierarchy. Before adopting, or even advocating for, any alternative it would due a huge benefit to sit down and consider the ways in which such a system would be mishandled, abused, and used maliciously by end-users or bad actors. 2. Do the gains outweigh the growing pains? In the event that the potential gains of change seem particularly appealing - and the concerns of point 1 have already been thought out and addressed - are the gains of that change significant enough to follow through on actually doing it? There are many cases where something has been vaguely improved on in some way or another across many industries, but it is a rare thing that the improvements of those changes have justified the time and investment by the participants of that industry as a whole. So: if the primary gain of Digits is to make searching faster, does that gain of search speed outweigh the task of changing a very fundamental aspect of how computers operate today? My personal opinion is "No, but..." There is always room for improvement. I think that if such a system finds more ways to entice people to adopt it, to find more depth and measurable, tangible benefits of adopting it, it will have a much stronger case to make. Speed is great, but we need more than that. --- From my perspective, I have very little issue finding files I need. I take pretty good care in keeping my files/folders well organized. I find it relaxing to organize things in a logical way. I even like organizing file structures at work, and for people in my personal life. I see this as a "non-problem" - it's a thing I actively take satisfaction from fixing. In the event the author of the post reads this, I give you this challenge: Give me a better alternative. Give me a system that can reach the same sort of satisfaction that I get from highly organized file system layouts. Justify why I should no longer need to do that. I'm not opposed to change entirely, I just don't see a very clear gain from it, in it's current form.
- richardw 5y agoI’d love this. Been wanting something better forever. A bit related: I want to click on a project name and it should set up my environment ideally for that project. Filter the files, include/exclude the apps I see, filter bookmarks. Just show me what I need for this one project, not all the crud across my whole life. Where anything is linked to multiple projects, let me include/exclude at will. This would all be especially useful when I haven’t touched a project in a year or two and can’t remember exactly where everything is. Two monitors? Project view on each, drag between them.
- julienpalard 5y agoman locate
- ncmncm 5y agoI thought this was going to be about replacing the inherently race-ridden Posix file system interface with something that has a well thought out, defensible design and API. In the old days, that would mean I need to do one myself. But nowadays, you assume somebody else must have done that already, so you go looking for it. If it doesn't exist, it was probably too hard, so you give up. Or maybe you find some, but all are unsatisfactory in some way. Then you might synthesize what you like from them all, and add some private improvements, and publish that. Or maybe you find one you really like, and you download and try it. Then you write an article, something like "The Time Has Come to Replace File Systems" or "File Systems are Racist" on your blog. Somebody posts that to HN, and it generates passionate interest. Shortly after, it appears as a module for Linux, or maybe for some popular embedded kernel used to implement USB keys. And, it's off to the races. Or, off to no more races. Or something.
- pontifier 5y agoI've never seen a way to organize files that feels like it prioritizes files based on how much they mean to the user. By that I mean pictures I take, papers I write, things I really wouldn't want to lose, vs 10,000 random system files. For downloaded files sometimes the history of when it was downloaded, and from where, is almost as important as the contents. Backups from old computers, and old phones start to pile up, and the chaos of trying to find that picture you took 3 phones ago, or the notes you took, or the recording you made, or the pdf you downloaded, or that code you wrote, or that map you made, is a real pain. Digital clutter is one of my biggest problems. I really need a good way to deduplicate and organize ALL my digital stuff. Tags might play a role, but I don't think they quite solve the problem.
- d--b 5y agoThis is one of these ideas that always float around. Files should be located by tags, not folders. Or file systems should be relational databases or file systems shouldn’t exist at all, etc. But the fact is people are used to files and folders. Tools are built upon files and folders so changing everything is extremely difficult. Plus all the tools that have tried to do things differently proved to be a pain: 1. Gmail tags: does anyone use the tag any diffrently from folder/file. Having multiple tags on an email means it’ll show up everywhere 2. Iphones didn’t have files, but it was so inconvenient it was added back 3. Microsoft relational file system was never released (i think)
- kevincox 5y agoFor GMail I often used "non-folder tags" for example I would tag emails based on the to address and they were clearly marked in my inbox. Or I would tag certian types of emails so that I can review them later. For example SMS would be tagged, but I would read them in my inbox. I just really wish GMail archiving was a tag. For example I get my video subscriptions into a tag called "Videos" but when I am done I remove the tag and that info was lost. It would be nice if Archiving was just adding an "Archived" tag and it was excluded from tag views by default. That way archiving doesn't forget all the tags. The only workaround I am aware of is making two tags for everything like Videos and Videos-Archive. Apply both in filters then just remove one once you are "done" with them. Folders have the same problem. Of course trash systems work around this by explicitly recording the original location.
- DeathArrow 5y agoI never have issues finding files. I am not particularly discipled and keep things very tidy, but I have folders for everything. Documents have their folder, software projects have their folders, photos have their folders, and so on. If I need to search for something I know where to look. I won't necessary dislike another system to keep files organized and find them, beside a hierarchical one, but I have yet to meet one which is better than a file system.
- enkrs 5y agoI like the idea, but I think it will not change the world. Filesystems have already been reduced to storage mechanisms for systems not people. People just don’t organize files anymore. And that’s a good thing. Most employees in relativley fresh organizations keep their files in OneDrive and Dropbox. 10..15 folders of random names and good search function that returns recent files on top. The older files just lie there, not botheting anyone because nobody is looking. Files from other departments are found via links in Mail and Slack search - not as attachments to Email. People launch Powerpoint (online) and use the recent files menu instead of browsing from the ”C: drive” To rethink storage ignoring that people don’t store files anymore is futile. It’s nice for organized geeks (like me), but in general file organization is a thing of the past.
- tremon 5y agoPeople launch Powerpoint (online) and use the recent files menu instead of browsing from the ”C: drive” Yes, I do that too. But that's because I have to, not because I want to. Onedrive, Sharepoint (and I guess Dropbox too) are impossible to navigate otherwise, so yes, even people that understand hierarchies are forced to use an application's LRU list to find old documents. That's not a sustainable situation. I foresee huge storage bills for organisations because they won't be able to afford to curate their growing terabytes of disorganized file storage.
- dmje 5y agoRelated: can anyone please tell me why Google Drive search is so bad? It’d be bad if it was built by some random tech company. But it’s built by Google who I believe have some reasonable capability in search… It’s just absolutely useless. Like: I’m a half assed php developer and I could probably knock something up that returned more useful results from a drive search. What gives?
- paulmooreparks 5y agoThe proverb for this is, "The cobbler's children go unshod." An organisation that has specialised expertise usually deploys that expertise where it has the largest impact, because it is limited. Hence, the cobbler spends all his time making shoes for paying customers, and he has not time to make shoes for his own children. So, the Google Drive search implementation is probably closer to what you supposed than what you'd expect if they threw the full weight of their search expertise at it.
- jaclaz 5y agoSmall nitpick: >The size of this record in popular file systems can range from 256 bytes (Ext4) to 1024 bytes (NTFS). On 512 and 512e disks, where the NTFS record is two sectors, in 4K "native" disks the NTFS record becomes 4K, i.e. e single sector.
- didgetmaster 5y agoGood catch. When I ran 'fsutil fsinfo ntfsinfo c:' it reported the bytes per FRS as 1024, but then I realized my c: drive was an SSD which must have 512 byte block emulation on. The hard drive shows 4096 bytes per FRS. I forgot about this when writing the article. That makes the difference between my record size and NTFS's even greater (1/64 vs 1/16).
- jaclaz 5y agoAs a side note, for extremely small files, the actual file content is written directly the $MFT entry, the size limit is around 700 bytes for 1024 bytes $MFT records and around 3750 for 4096 bytes $MFT record. Some reference, JFYI: https://www.forensicfocus.com/forums/general/mft-resident-data/ https://www.forensicfocus.com/forums/general/mft-resident-da...
- mikewarot 5y agoI have 394,175 photos and videos that I have personally taken since 1997. They are organized by a simple hierarchical system in 5,356 folders. D:\masterarchive\source\YYYY\YYYYMMDD\photo file name If I want to find a person, in a photo, I've used Google Picasa (when it was an offline product) and lately digiKam to do face matching, and tagging them with IPTC metadata tags in the photo files. Thus they survive moves across filesystems, etc. I'm up for seeing alternatives, but there's a very high bar to clear here. People have been using directories and file storage since the middle ages.
- loxias 5y agoYou, as a data point (and I, and I imagine many people on HN), are strong evidence of the rule "sufficiently motivated and clever end users will always find a way to do what they want, regardless of the interface". But that isn't really saying anything about if the interface sucks, or could be improved, just that you're motivated and clever enough to find a good and scalable solution for what you want to do given the limitations of the interface.
- MrPatan 5y agoI do the same. This is the only way to organize things, by date. I do the same with documents. I don't even want to think about categories, ontologies are always wrong. But today is 2022-02-24, no two ways about it. It's automatic, there's no need to think or decide anything, so it's not a big deal, you just do it. You can't make a mistake. The thought of needing to properly tag every document I file is enough to make that a task I want to postpone. So it wont get done. That's a worse filesystem right there, because it doesn't exist.
- lloydatkinson 5y agoDisappointed article never mentioned WinFS which indicates to me that the article didn’t actually have much research put into it.
- didgetmaster 5y agoThe article was never meant to fully describe the Didget system or all the issues that went into its design. One of the reasons I started working on it years ago was because Microsoft cancelled its WinFS product and I wanted to see it in action. I decided I had to try and build something on my own. I can assure you that I put a lot of thought and research into it.
- gorgoiler 5y agoWhat’s the state-of-the-art of command line file searching? I have a macOS machine and mdfind is awesome but something similar for Linux is not yet in my toolbox.
- Piskvorrr 5y agofzf is nice, but I'm not even sure it is what you're searching for (pardon the pun).
- rhn_mk1 5y agoI badly want to try it out and see how it fares in practice, together with some integration with open() calls for interoperability. But where to get it?
- MrPatan 5y agoMaybe what needs to be replaced is the meme that people can't deal with hierarchical filesystems. That may have been true 20 years ago when the average person didn't use a computer too much. Is that still true today? Will it be true in 10 years? Is designing a filesystem the product people's equivalent of the developer's game engine?
- fxtentacle 5y agoI don't think file systems will be replaced anytime soon because of psychology. The human mind remembers things best by attaching them to a real or virtual location. That's how all the memory experts do it, they construct a virtual house in their mind. Virtual rooms, shelves, boxes, and folders are no different. So if anything, I'd give the Filesystem different folder icons based on their depth to reinforce this similarity with the real world. Also, the article seems to use strawman arguments. Nobody needs to remember the exact image file extensions. You just click on the "search for images group" in windows and it'll search all image file extensions for you. In effect, tags are already there. It's just that they are automatically generated.
- bob1029 5y agoI'd be perfectly happy if all file systems were flattened into a sql interface. The relational model is the only thing flexible enough to give all users what they want. Imagine being able to define custom triggers that update cross reference tables when certain file system operations take place. Or, building custom views of storage system for various use cases. Having the user shell tightly integrated would be nice too. I'd like to be able to write a query like: SELECT foobar2000_enqueue(t.id) FROM vTechnoBunkerTracks t WHERE t.PublishedYear > 2021
- paulmooreparks 5y ago29 years ago, I worked for a little software company called PC DOCS that wrapped WordPerfect with the ability to have long file names, keywords, and full-text search. It was like sheer magic in the days of 8.3 DOS filenames. After I'd been there a while, I figured that's what the future would look like one day: no more hierarchical file systems or file names. Current-day me would be embarrassed to tell 1993 me that things haven't really gotten much better. Sure, we expanded the 8 in 8.3, and the 3 grew to 4 or so, but I still spend an inordinate amount of time staring at a spinny widget whilst waiting for the OS to find a document.
- fungiblecog 5y agoJust no
- verisimi 5y agoI totally agree with this article - I've made similar points myself. I would also add, that how terrible is it if you have a file that applies to 2 or more areas, areas that you distinguish by folders? Eg say its a photo - you might want to have a 'family occasions' and '2019' folder - ie one photo might apply to 2 areas that you want to distinguish. Well, that level of organisation is effectively punished - you can either duplicate the photo in 2 places, or lose the reference in one. If you improve the photo using say, photoshop in one place, you better remember that you have a copy and remember to copy it over there too! For me file systems were designed wrongly. For personal files there is the data and the meta-data. But the only meta-data we can add is in the file attributes. Data should go into a 'bucket' and be stored by the OS somewhere, never duplicated. Meta-data relating to the file should describe features of the data, where to get it (perhaps in multiple places). It should be possible to apply multiple labels to it too, in my example 'family occasions' and '2019'.
- _glass 5y agofor this you have links, i.e. ln https://en.wikipedia.org/wiki/Ln_(Unix) https://en.wikipedia.org/wiki/Ln_(Unix)
- verisimi 5y agoI know about links, and there are one or 2 other solutions I've looked at 2. But that's not really what I'm getting at. Links are pretty cumbersome, get broken, etc. They sort of work in the avoiding the duplication issue I mentioned. They don't work in the sense that what the (non-techy) user wants to do with data is an afterthought - ie the order of priority is computer, then user. What I'm talking about is that the meta-data describing personal files should be where the user adds their value to - they should be able to describe what the data means to them and that should only need to be done once. The data itself should be handled by the OS; where it is etc is not really a big concern for the user themselves.
- anonymoushn 5y agoThis doesn't seem great. Soft links are not resilient to renames or removals of the "canonical tag". Hard links are not resilient to improving the file in photoshop.
- ThePhysicist 5y agoSystems that try to get rid off the "files & folders" abstraction of a file system tend to have much worse usability, in my opinion. I have an iPad Pro, and the lack of true file system abstractions is so painful. Every app has its own way to store and retrieve data, there's almost zero interoperability and it's super painful to copy, paste and move stuff around (I know it has gotten better but it's still so much worse than on any desktop OS). I'm all for enriching the concept of a file system with additional meta-data (in fact many files do that) but I don't think that needs to happen in the file system itself. For example, software like Picasa leveraged meta-data contained in files to provide a new way of interacting with large number of photos. The author basically proposes to put such functionality directly into the file system, but I'm really not sure if that's a good idea. Right now it's easy to move files between different systems, e.g. from Mac to Windows or Linux. If file systems become meta-data management databases that will become much more difficult.
- slightwinder 5y ago> Systems that try to get rid off the "files & folders" abstraction of a file system tend to have much worse usability, IMHO it's because those systems just simplify, but don't move very deep in the space they opened up. If you don't offer power, then it's irrelevant which system you offer, they will all suck fast. > Every app has its own way to store and retrieve data, there's almost zero interoperability and it's super painful to copy, paste and move stuff around (I know it has gotten better but it's still so much worse than on any desktop OS). Which is kind of a surprise, I would think Apple would be interested to unify that space and offer a good user experience. > Right now it's easy to move files between different systems, e.g. from Mac to Windows or Linux. If file systems become meta-data management databases that will become much more difficult. Theoretically, it could be solved by using a meta-file-container. Something like a tar-container, which contains a file for meta-data and the actual content. We have this with specialized container-formats in media and office-filetypes. Making a universal format which would work equally well for any kind of file type could solve this problem of interoperability. This would even open up ways to improve files without changing them directly. Like adding subtitles or notes to a file, by just adding it to the container, not the file itself.
- deleted 5y ago[deleted]
- hamsamrma 5y agoobligatory: https://www.xkcd.com/2531/ https://www.xkcd.com/2531/
- slightwinder 5y agoIf one has forgotten where they stored a file, then no database will help them either. A file system in the first place is also a database, and whether hierarchical or relational database, they are only as useful as the data they contain and the tools we shot at them. The problems this aims to solve are from the user layer, but the majority of files are used from the system itself. The system does not need such solutions, it's working well with the established solutions. Or is there any research in potential benefits for distributions when using a relational file system, instead of hierarchical ones? Another point is that this would probably bring up new issues. Is there any system with real experience on this that can say what will change, what will be better, what will be worse? But, it's also true that we should improve and innovate this at user level. Having every app separately indexing files and handling them is a poor situation. Working toward a generalized solution would be beneficial. Maybe a universal relational database layer as a foundation for all apps would make sense? Something that can have a tight integration with the Apps, and is on top of the normal file system? Thus, is would be the job of Desktop Environment to offer and integrate this. KDE did try it at some point, but seems to have failed with it for many reasons. Maybe they should restart this, but more pragmatic and enforced, and probably in a fork as a testing ground. I remember that one problem they had, was working on multiple systems in parallel, each limited to certain apps. But there should be only one system, and it must be integrated into every app the same to be successful. KDE with it's centralized, and mature libs would be perfect to enforce this. Gnome might be able to pull something similar, but I don't know how the state of them is today. Of course this would only be a first step, but if some major DE would solve this for them, others could join it, and they could start building an independent solution. And maybe, from there, they could work toward a specialized file system that improves things even more, if really necessary.
- bawolff 5y agoWhat isthe difference between a tag and filesystem (directory)? I guess a file having more than one "tag" - but multiple hard links have been a thing in file systems since forever.
- iggldiggl 5y ago> but multiple hard links have been a thing in file systems since forever. The UI around creating/managing/deleting them is worse than with a properly supported tagging system, though. Plus they're prone to breakage by any program that attempts to do atomic saves (i.e. renames the old file first). While I certainly wouldn't want to give up hierarchical file systems as the default, there are a few things where I'd really wish for some OS/file system-level support for tagging, too
- whywhywhywhy 5y agoEvery attempt to replace it has just been proof of how great the file system is IMHO.
- robertlagrant 5y agoThis article seems to conflate two separate issues: 1) File systems could be modernised. 2) Files and folders as a metaphor break down when you have enough files, vs, say, search. (1) is almost certainly true. (2) I don't think I agree with. If people use something like Confluence, things still get disorganised if people (such as me) make documents and folders in a way that's a mess, then they'll be a mess no matter the metadata.
- sirwhinesalot 5y agoFolders impose a tree shape to file organization which then has to be awkwardly worked around with symlinks, indexes and whatever the heck those library things on windows used to be. That said folders are useful as a concept, but maybe flip things so that the folder is a tag on the file, and I can "move" or "copy" a file by changing its tags. And still present a visual folder structure by default in the file browser. The biggest loss with this approach is namespacing... Not sure what the best option there is.
- morelisp 5y agoOh boy, web3 really is back!
- WesolyKubeczek 5y agoListen here, a hot take incoming. There are two absolute genius inventions in computers so good and timeless that the sliced bread pales in comparison like a stupid troll comment on HN. 1. The keyboard 2. The hierarchical filesystem Everything and anything else in input devices and data storage builds on these and the best solutions ever always are going to augment these, never replace them. A good tag system will build on top of a filesystem and coexist with it, and offer value like stupidly fast search. Anything else will be lucky to survive a weekend of dubious fame on twitter, or up to a few months if you actively market it.
- mro_name 5y agoThe time has come to replace <enter whatever you dislike just now>
- humanrebar 5y agoThe article and everyone in this discussion is talking about photo tagging and such. What I want to know is how configuration management, source code organization, build systems, packaging systems, and other experts tools will work without a hierarchical filesystem. If you're designing a camera application, sure, maybe you don't need a hierarchical filesystem if you have other means of organization and discovery. But who's going to be able to code that camera app in the first place? And when "it" is installed, what exactly happens?
- kevincox 5y agoThese systems were designed for a hierarchical filesystem so it is natural that that is what they support. I'm sure that if tag-based filesystems were the default they would have an equally suitable design that worked well there. This could be as simple as specifying the "project" as a set of tags. For example project=camera and maybe compile a submodule with project=camera,module=ui. Then the files inside could be processed by the build tool. Of course for any tag-based filesystem to take over it will probably need a compatibility mode. I can imagine something simple as a path=myproj/src/main.rs.
- humanrebar 5y agoMy point wasn't that it would be impossible to create a new kind of solution. It's enough that it would be a massive undertaking for unclear benefit, if any. If we get rid of hierarchical filesystems, what replaces got, for instance? Perforce has some ability to project different filesystem hierarchies, but even if that were enough (it probably isn't), porting all those tools and projects to perforce would be an incredible amount of work without a clear upside for users of version control systems.
- EleanorKonik 5y agoThis is the piece I've been struggling to get at. I understand why filesystems exist and how they help with interacting with the physical structures that underlie computers, but I don't understand what benefit a database alternative to directories can offer (and if you tell me a directory is just a specialized database please be prepared to explain using very clear language). Maybe there is one, but even when I talk to experienced devs with engineering (not just software) backgrounds, I haven't gotten a good explanation. Perhaps because there isn't one? But I've been curious about this for weeks.
- bborud 5y agoWhat this boils down to is that he thinks a flat namespace (tags) offers advantages over hierarchical namespaces (tree). They really don't. Once your tag space grows you will start to struggle with naming, and path-like structures (nested namespaces) start to creep back in. And you are right where you started: paths. The treatment of immutability is too superficial to make any sense of so I don't know what the author is imagining. Ted Nelson has evolved some ideas on this for decades that might be worth knowing about. Some of which have kind of come to pass (if you squint and look at how non-destructive editing tools for video and audio work, for instance). However, very little of Ted's thinking has ever been burdened by usable implementation. The concept of having multiple references to the same file already exists. So what he proposes can be realized with existing file systems just by introducing a different naming scheme and making extensive use of sym-/hard-linking. Yes, a lot of file systems will have terrible lookup and traversal performance, but that problem exists in an orthogonal universe and can be solved. Is, indeed solved, in some fileystems if the marketing blurb doesn't lie. If you think about how you would realize this using existing filesystems, by organizing them differently, the concept isn't as sexy anymore. Because it doesn't really involve a lot of new stuff and you start to see the inconvenience of having to cope with both novelty and problems you didn't have before. The problems someone like me wants solved in filsystems are entirely different, and aren't so much about filesystems as it is about how you make the functionality useful to applications. For instance, there are filesystems that offer snapshot semantics. Including COW-snapshots. This would be useful whenever applications need to do be able to roll back changes, switch between states, do backups while being live etc. Yet I know of no language which has snapshot as part of the standard OS interface. So people generally don't write application that take full advantage of what the underlying system offers.
- magicalhippo 5y ago> And you are right where you started: paths. A big difference is that one can naturally have multiple tags, and an entity could share tags with other entities. Sure you can use hardlinking when it comes to files, but it's tedious and you can't have multiple files hardlinked to the same path.
- 5y ago
- hanselot 5y ago
- unixhero 5y agoThis is what we have information systems and databases for, on top of filesystems.
- bodge5000 5y agoFile systems are pretty instrinsic to how modern computers work, replacing them would be a monumental task not just for users but for the architecture of computers. Of course you don't nessecarily need to replace it, you can just use new tools on top of it, like you do with iOS and to some extent android. Both of those use file systems even if you never see them. But in any of those cases, you're still using a file system, with all the apparent problems that come with them, you just have an abstraction layer on top to make it easier (or at least different) to navigate. For me, file systems are about as tried and true as you can get, they're not perfect but they do the job well enough to consider the cost of replacing them too great.
- xattt 5y ago> File systems are pretty instrinsic to how modern computers work, replacing them would be a monumental task not just for users but for the architecture of computers. Is this true for spinning disks only or does this apply to SSDs as well? I understand that APFS tried to shoehorn SSD-like operations into the FS layer.
- projektfu 5y agoData organization is constrained by the worst system, because of interoperability. How do you move these tags across the internet through systems that don’t understand them? For example, the Mac had “file types” and “creators” as separate metadata since the beginning. Because type wasn’t encoded in the filename, mistakes weren’t made that accidentally changed the type and you didn’t have multiple files of the same name differing only by extension. The file always opened in its creator but power users could easily change the creator. To make a successful round trip to another system, the file would need to be given the right extension and then another program would need to reassign the file type and creator on reentry. If you didn’t do it right, people would complain that they couldn’t open the document. In addition, experience shows that organization must happen automatically or people will just let it do whatever. At this point, most users probably have all their documents in one folder and all their downloads in another. If they weren’t indexed automatically, they’d just give up and say they don’t have the documents anymore. Come up with an intelligent way to organize automatically and it will be a real revolution. I’d like to be able to find that photo I saw a few weeks ago when I need it. I want all the documents that are similar to the one I found that isn’t the exact version I wanted. I want all the photos taken in Brazil as well as unlabeled photos that might be Brazil. I want the EPS version I have of this jpg logo
- api 5y agoIf filesystems were replaced with a new paradigm today it would be a centralized SaaS where every operation requires a round trip to the cloud and ads show up alongside your data unless you pay a monthly subscription. Every single thing you do on your computer would be streamed to advertising analytics farms. Without an Internet connection it would be impossible to access your data. ... being sarcastic ... I think ... maybe ...
- anthk 5y agoKeep it simple, stupid. Hierarchical FS's work. Just don't be lazy and tidy up yourself. Most of innovation on tech is not needed. Would you redesign a spoon or a fork being centuries old? No. It works. Something like BeOS/Haiku's filesystem would have more sense, but yet useless on sharing the files with the rest of FS. Just look what happened with resource forks on Classic Mac.
- ho_schi 5y agoIt feels like the author didn't like tree based file structures? The provided software in the screencast remembers me of iTunes. Which I dismiss because it doesn't provide a logical *tree like structure*. And it is not a filesystem replacement either, it is a database which adds a lot complexity and hides actually data. Furthermore this assumes someone is maintaining the metadata (remember the MP3-Taggers?) instead of the files. Metadata itself is useful but the creator of the file should add it not the user. Regarding file manipulation the proven answer are file permissions but I think CGROUPs are the flexibel, modern approach. Because I'm seeing "Windows Explorer" in background: Windows Explorer has degraded in recent years, it is even hard to open your "home directory" and the UI is confusing. Look at the one from NT 4.0 which was much more close the fulfill the task. And Apple: I think the regret nowadays the howl iTunes? But instead the pushing hard on apps which contain the data. Now you have to look always into a single app and uses it facilities to retrieve a file. Android failed here, too. But using iOS is hard.
- ubermonkey 5y ago>it is even hard to open your "home directory" Windows clearly doesn't want people to GET to their home directory, for some reason. That seems goofy. If people don't understand that $user contains the rest of those folders (Documents, Downloads, Pictures, etc) they'll never be able to navigate on their own. That's bad. In a sane tool that features an address bar, clicking any given directory would show, in the address bar, the path to that location. WinExp only rarely does this. If you click on, say, Desktop, it shows you This PC > Desktop, implying a relationship that is incorrect. Getting to your home folder without typing requires you to start with C: and drill down, which is objectively insane. Even MORE bananas is that if you start at C: and drill down to Desktop, you DO get the correct path in the address bar. But if you then make a WinExp shortcut of that location, it goes back to the other behavior. WTF.
- ho_schi 5y ago> Windows clearly doesn't want people to GET to their home directory, for some reason. That seems goofy. If people don't understand that $user contains the rest of those folders (Documents, Downloads, Pictures, etc) they'll never be able to navigate on their own. That's bad. Yes. Windows prevents users nowadays from understanding a straightforward thing, file-systems. I mean it was always a bit clumsy with A:, C: and [D-Z]: and the weird desktop metaphor harmed as well. Now I'm looking at the often criticized GNOME and the actually venerable Nautilus. They got it! All below / and in addition devices are directly usable (actually still somewhere below /run). The location bar reflects the current position. The desktop was removed because it never fit into a computer and the file system. Some actions of Google within Chrome are also questionable. "There is not address entry field" because we don't want you to understand how the web is structured. What? File-Systems are a simple thing, hierarchical. And guess what, the web is similar. Compared to "right click", "double click" and it's new friends "long press", "hard press" and "swipe from somewhere" and "guess what the voice assistant can interpret".
- spacexsucks 5y agoFiles give you ownership of the data. Tags make you slave to an intermediate layer between the data and you. Let me jnow when you have replaced your filing cabinet with just tags.
- halayli 5y agoI am not sure OP knows what a filesystem mean in the first place.
- 0thgen 5y agoit'd be cool to see an information theoretical explanation of the complexity of hierarchical -vs- non-hierarchical file systems, and why human beings have such an initially easy time with hierarchies. there's the obvious inheritance factor: the parent of a child in a hierarchy can provide a _heuristic_ about properties of the child. you sort of get this with a tagging system, but the inheritance can really only go one level (unless you make a hierarchy of tags, which brings you back to tree structures)
- dzaima 5y agoheh, the tag names in that demo video follow a hierarchical structure - .didget.Name, .didget.SHA1, .fileSystem.Ancestor, .fileSystem.Folder, .... So now not only do you have a hierarchical (but optional, which is worse imo) structure for files, you also have a hierarchy for tag names (which, unlike with folders, you can't really rename if they conflict because they're singular keys).
- gverrilla 5y agoI'm fine with the filesystem, but I would like each file to have a unique identifier instead of path
- deleted 5y ago[deleted]
- deleted 5y ago[deleted]
- Steltek 5y agoSheesh, organization and hierarchy are not the problems with file systems. It's the APIs and the network awareness. Can someone name a network filesystem that doesn't suck horribly in some way? Samba? NFS? CephFS? GlusterFS? They all have some glaring problem that holds them back. We need storage that works everywhere and that doesn't suck. DropBox, et al, tries to make it happen but they're held back by mediating everything through the filesystem layer. Traditional filesystem concepts aren't going to make that happen.
- barrkel 5y agoTagging is work. Fiddly work that's surprisingly costly in effort if it's not trivially automatable stuff like time and date, location, application, and so on. Naming is hard work, but tagging means creating and choosing shared names all the time, with the pressure that the combination needs to be reasonably unique, otherwise you won't find stuff. Tagging is also fiddly if you don't have a really good bulk action UI. You can think of the user-controlled paths in a hierarchy as tags, and moving files is the action of untagging and tagging. By moving 100 files from one directory nested three/levels/deep to another, you are removing 300 "tags" and adding 300 different "tags". And you can rename the "tags". A single click and drag, 600 actions, and you can see the before and after trivially, and undo trivially too (at least in Windows). Tagging is more useful for ad-hoc "favourite" lists, and the occasional cross-reference (but it's work to hunt down the elements in the xref).
- ehutch79 5y agoI've been seeing this shit for decades. The problem is as soon as you end up with a tag/search system with any complexity, you end up recreating paths/folders/whatever again. As soon as you have a multiuser system, you're forced into it. No one has ever justified to me why i need to stop referring /etc/whatever/config or /users/username/whatever We'd either need to scrap everything we use today, or emulate it anyways to use things like cp or mv. The answer is both. Tags are useful, but not a replacement.
- joshu 5y agoI'm a huge fan of tags (as I promulgated the idea in the first place in the early 2000s) but they have a bunch of problems. They're better understood as a memory extension system rather than a sole filing system. The idea being that it improves recall of objects if you add some attributes when saving as you are likely to use some of the same attributes when recalling. But the vast majority of objects on a filesystem are mechanically generated and never touched by the human using it (assuming a sole user.) The model gets much more complicated when many users are interacting with the same system. As noted elsewhere, the flat namespace gets cluttered very quickly. I do think that there is use for a hierarchical separator since many times objects are fully inside some other concept. And when looking at massive userbases creating tags for memory, there is a distinct ordering of generic to specific when creating tags in order. Also, filesystems also allow a bunch of workflow that aren't completely obvious under tagging. For example, a business might copy their template folder and rename it for a new customer, and inside it it has a bunch of documents with the same names. I think this a bit like having a bunch of objects (in the programming sense) thus creating things that all have the same method names (except now they are files, for example)
- jmull 5y agoThe article breezes past the obvious (and widely implemented) idea of indexing on top of existing file systems. I think it would be a lot more useful to improve on that than pursue yet another quixotic file system idea.