10 ms·
Magic Wormhole: get things from one computer to another, safely
- ku1ik 2y agowormhole is awesome, useful especially in ad-hoc scenarios. I use it often to copy files between systems when I can’t use scp (because of no relevant entries in authorized_keys.
- samstave 2y agoCan I use it with my buddy on the other end and connect his machine to mine easily? Like let him slurp a file from my home machine?
- TheRealPomax 2y agoJust set up a VPN if that's what you want?
- lotharrr 2y ago(author here) The protocol enumerates all the IPv4 addresses on each side, and attempts to connect to all of them, and the first successful handshake wins. So if your VPN arrangement enables a direct connection, `wormhole send` will use that, which will be faster than going through the relay (and cheaper for the relay operator). A basic VPN gets you safe connectivity between the two sides, but transferring a file still requires something extra, like a preconfigured ssh/scp account, or a webserver and the recipient running `curl`/`wget`. magic-wormhole is intended make that last part easy, at least for one-off transfers, just `wormhole send FILENAME` on one side, and `wormhole receive [CODE]` on the other.
- TheRealPomax 2y agoRight, I'm more commenting on the "have my friend slurp files" part: that sounds more like they want to set up a VPN with normal file sharing (e.g. full network shares) so their friend can just grab literally anything as long as it's in a network share. It didn't sound like they needed individual file transfers.
- tptacek 2y agoYes.
- hoppyhoppy2 2y agoA similar project with some nice features that I use is croc: https://github.com/schollz/croc https://github.com/schollz/croc
- Lord_Zero 2y agoI love croc
- xbkandxe 2y agoDitto. Been using it for years to transfer very large files to friends when throwing them up on my webserver will be too slow.
- fn0rd_ 2y agoMaybe stay with wormhole https://redrocket.club/posts/croc/ https://redrocket.club/posts/croc/
- Twixes 2y agoGot fixed pretty thoroughly though, it seems! https://schollz.com/tinker/croc9/ https://schollz.com/tinker/croc9/
- glitchcrab 2y agoI found this quite uncomfortable to read because of the complete lack of capitalisation - it's a very odd choice.
- archon810 2y agoDefinitely. Who writes like that and expects to be taken seriously?
- Klathmon 2y agoI've used https://file.pizza https://file.pizza a bunch before, only because of the memorable name
- smusamashah 2y agoThere are a few others p2pcopy https://github.com/psantosl/p2pcopy https://github.com/psantosl/p2pcopy pcp https://github.com/dennis-tra/pcp https://github.com/dennis-tra/pcp wormhole-william https://github.com/psanford/wormhole-william https://github.com/psanford/wormhole-william
- singularity2001 2y agoscp
- dgrove 2y agoscp has the assumption that you have a login on the computers you're trying to share data from. wormhole allows for sharing with others without providing login access to the computer
- __MatrixMan__ 2y agoRight. Also you may have to reconfigure some firewalls to use scp. Typically, a firewall allows outbound connections without needing an explicit entry for the protocol, and in the case of magic wormhole, both sides are an outbound connection. So it passes right through. If you've got security-minded folk managing that sort of thing for you, it's possible that magic wormhole will upset them for this reason. More for policy/compliance reasons than actual security ones.
- layer8 2y agoBoth problems can be worked around by having a third, general-purpose host where both source/destination hosts can scp to/from. Not quite as straightforward because you have to copy twice and do it from both sides, but has the benefit of not having to install bespoke software.
- TacticalCoder 2y ago> Both problems can be worked around by having a third, general-purpose host where both source/destination hosts can scp to/from. Yup it's what I do, that 3rd computer having a fixed IP. Conveniently that computer can also keep a copy of the file(s). Linux/BSDs/OS X (which is kinda a Unx too) all come stock with scp* and I don't really use Windows, so I'm a happy camper.
- dunk010 2y agoTailscale has that Taildrop thing now, too: https://tailscale.com/kb/1106/taildrop https://tailscale.com/kb/1106/taildrop
- tptacek 2y agoTaildrop is neat, but Wormhole is much more flexible and much easier to use (if you're OK with a command line tool). We use Tailscale everywhere here and I still wormhole things all the time.
- netsec_burn 2y agoI've used wormhole once to move a 70 GB file. Couldn't possibly do that before. And yes, I know I used the bandwidth of the relay server, I donated to Debian immediately afterwards (they run the relay for the version in the apt package).
- teruakohatu 2y agoThe wormhole transit protocol will attempt to arrange a direct connection and avoid transferring data through the relay.
- bredren 2y agoIs there a switch to fail rather than fall back on relay?
- lotharrr 2y agoNot really.. the closest approximation would be if both sides set their `--transit-helper` to an unusable port like `tcp:localhost:9`. That would effectively remove the relay helpers from the negotiation list, leaving just the direct connection hints. But you can't currently force that from one side: if you do that, but the other side doesn't override it too, then you'll both include their relay hint in the list. Note that using the relay doesn't affect the security of the transfer: there's nothing the relay can do to violate your confidentiality (learn what you're sending) or integrity (cause you to receive something other than what the sender intended). The worst the relay can do is to prevent your transfer from happening entirely, or make it go slowly.
- lotharrr 2y ago(magic-wormhole author here) Thanks for making a donation! I run the relay server, but the Debian maintainer agreed to bake an alternate hostname into the packaged versions (a CNAME for the same address that the upstream git code uses), so we could change it easily if the cost ever got to be a burden. It hasn't been a problem so far, it moves 10-15 TB per month, but shares a bandwidth pool with other servers I'm renting anyways, so I've only ever had to pay an overage charge once. And TBH if someone made a donation to me, I'd just send it off to Debian anyways. Every once in a while, somebody moves half a terabyte through it, and then I think I should either move to a slower-but-flat-rate provider, or implement some better rate-limiting code, or finally implement the protocol extension where clients state up front how much data they're going to transfer, and the server can say no. But so far it's never climbed the priority ranking high enough to take action on. Thanks for using magic wormhole!
- alanbernstein 2y agoI realize this is a dumb question, but what's a good way to do this between an iPhone and a MacBook? Airdrop is disabled (by policy), iCloud storage is full (because I'm lazy), and I use syncthing on every other device, but I haven't found a client I can use on my work iPhone.
- DavideNL 2y agohttps://mobiussync.com/ https://mobiussync.com/
- sdoering 2y agoCame here to say syncthing and Möbius Sync. Works like a charm for me between Win, *nix, macOS, Android and iOS. But getting iOS to sync was a pain. Still, now it works just fine.
- tamimio 2y agoMobius Sync. Works like a charm.
- toastercat 2y agoMöbius Sync doesn't sync in the background; you must have the app in the foreground for it to function. So, not quite a proper substitute for Syncthing, but may work for OPs usecase.
- Tomte 2y agoOf course it syncs in the background. It‘s just not instantaneous, because iOS severely limits what you can do in the background.
- 369548684892826 2y agoRight, it does the best it can given the limitations of iOS, but "not instantaneous" can mean hours before synchronisation happens. When the phone's charging, or when the app is open, then it does tend to work almost as well as on Android.
- toomim 2y agoHow does this relate to https://wormhole.app/ https://wormhole.app/ ?
- ddtaylor 2y agoThat is something I want to know too. Do these various "wormhole" apps use any common protocol between them or do they just all use the same words and branding for different things?
- tptacek 2y agoMagic Wormhole is the first, and is its own thing. It's called "Magic" Wormhole for a reason: it tends to blow people away the first time they use it. So lots of people have copied the UX, and some of them have copied the name as well. What you should use is Magic Wormhole itself, or, if you want a non-Python runtime for some reason, wormhole-william.
- bdd 2y ago> if you want a non-Python runtime for some reason [...] Magic Wormhole project has its own alternate implementation https://github.com/magic-wormhole/magic-wormhole.rs https://github.com/magic-wormhole/magic-wormhole.rs, which is also used by delightfully designed GNOME and Android apps; [Warp](https://apps.gnome.org/Warp/ https://apps.gnome.org/Warp/), and [Wormhole](https://play.google.com/store/apps/details?id=eu.heili.wormhole https://play.google.com/store/apps/details?id=eu.heili.wormh...), respectively.
- ddtaylor 2y agoI find `syncthing` pretty useful for this kind of stuff. It's been around a long time and has a lot of different options for configuration and clients for every platform you could imagine, both UI based and command line. On every *nix platform I would just install the `syncthing` package and use it quite easily. I've experimented with some wormhole stuff before and looked at this package some, but there would be a lot of extra steps involved right because of the packaging choices. The package was removed from Fedora in 37 with the "replacement" being use a Snap instead [1]. That doesn't make any sense because that platform is heavily invested in Flatpak and it's very "against the grain." There are some other "Wormhole" apps on Flathub that are verified, but none of them are the same as this. Are they compatible protocol wise or just named similar things? That's assuming you want to enter the game of "is this app safe or made by the same entity?" I want to enjoy this project and others like it, but it's very confusing. The goal of these tools is to simplify transfer of files and to take most of the "pain" in doing that away. Yet, to actually use most of these tools in any meaningful way between two computers you would need to invest more time into getting this to run on those systems. My brain tells me to make this work you need a big button on the homepage for each well supported platform that just says "Download for Windows" along with a one-click solutions for various Linux platforms (one line command, Flatpak, AppImage, etc.) [1]: https://magic-wormhole.readthedocs.io/en/latest/welcome.html#installation https://magic-wormhole.readthedocs.io/en/latest/welcome.html...
- tptacek 2y agosyncthing and Magic Wormhole have different goals. Wormhole is very simple: it is a way (often the best way) to get a file from point A to point B, regardless of the connectivity (or lack thereof) between A and B, without accounts or configuration.
- ddtaylor 2y agoSyncthing also does relaying like that, NAT traversal, bridges, etc. all automatically. If it can, it will use local IP connections and go blazing fast. If for some reason your network configuration(s) don't allow for any valid connections, it will use a relay or bridge - either a default or one you setup - and work relatively fast as well.
- geerlingguy 2y agoI've used this for years when passing large files between systems in weird network environments, it's almost always flawless. For some more exotic testing, I was able to run my own magic wormhole relay[1], which let me tweak some things for faster/more reliable huge file copies. I still hate how often Google Drive will fall over when you throw a 10s-of-GB file at it. [1] https://www.jeffgeerling.com/blog/2023/my-own-magic-wormhole-relay-zippier-transfers https://www.jeffgeerling.com/blog/2023/my-own-magic-wormhole...
- cl3misch 2y ago> you need a machine that can handle whatever link speeds you need I would have expected the relay server only being used for initial handshake to punch through NAT, after which the transfer is P2P. Only in the case of some network restrictions the data really flows through the relay. How could they afford running the free relay otherwise?
- lotharrr 2y agoThere are two servers. The "mailbox server" helps with handshakes and metadata transfers, and is super-low bandwidth, a few hundred bytes per connection. The "transit relay helper" is the one that handles the bulk data transfer iff the two sides were unable to establish a direct connection. I've been meaning to find the time to add NAT-hole-punching for years, but haven't managed it yet. We'd use the mailbox server messages to help the two sides learn about the IP addresses to use. That would increase the percentage of transfers that avoid the relay, but the last I read, something like 20% of peer-pairs would still need the relay, because their NATs are too restrictive. The relay usage hasn't been expensive enough to worry about, but if it gets more popular, that might change.
- bscphil 2y agoThe folks on the wormhole-rs fork (who appear to share your Github organization? [1]) already have NAT punching working 95+% of the time in my testing, so maybe what they're doing could be ported over to the Python implementation. [1] https://github.com/magic-wormhole https://github.com/magic-wormhole
- DavideNL 2y agoJust noticed by coincidence there's also: "Rust implementation of Magic Wormhole, with new features and enhancements": https://github.com/magic-wormhole/magic-wormhole.rs https://github.com/magic-wormhole/magic-wormhole.rs
- Klonoar 2y agoThis lacks a few of the features of the other implementations (e.g, sending a zip and having it unpack correctly).
- meejah 2y agoThere is also https://magic-wormhole.readthedocs.io/en/latest/ecosystem.html https://magic-wormhole.readthedocs.io/en/latest/ecosystem.ht... and if that is lacking anything please file a ticket or pull-request
- zkader 2y agoAn alternative that tends to be faster (note: I'm one of the authors) https://github.com/SpatiumPortae/portal https://github.com/SpatiumPortae/portal
- MattJ100 2y agoCan you share why exactly it may be faster?
- lotharrr 2y agoauthor here.. happy to answer any questions!
- nickpsecurity 2y agoI just wanted to thank you for making it. I wanted it just to bootstrap VM’s on new machines. I ended up using it all the time for many things. Great project!
- twp 2y agoSeconded, magic-wormhole is fantastic and has "just worked" for me several times. Thank you for all your work in creating this brilliant software!
- matricaria 2y agoWhy is this better than rsycn or scp?
- lotharrr 2y agoscp/rsync are great tools, but they require pre-coordination of keys. One side is the client, the other is the server. The client needs an account on the server machine (so the human on the client machine must provide an ssh pubkey to the human on the server machine, who must be root, and create a new account with `adduser`, and populate the ~/.ssh/authorized_keys file). And the client needs to know the server's correct hostkey to avoid server-impersonation attacks (so the human on the server machine must provide an ssh host pubkey to the human on the client machine, who puts it in their ~/.ssh/known_hosts file). Once that's established, and assuming that the two machines can reach each other (the server isn't behind a NAT box), then the client can `scp` and `rsync` all they want. Magic-wormhole doesn't require that coordination phase. The human sending the file runs `wormhole send FILENAME` and the tool prints a code. The human receiving the file runs `wormhole rx CODE`. The two programs handle the rest. You don't need a new account on the receiving machine. The CODE is much much shorter than the two pubkeys that an SSH client/server pair require, short enough that you can yell it across the room, just a number and two words, like "4-purple-sausages". And you only need to send the code in one direction, not both. Currently, the wormhole programs don't remember anything about the connection they just established: it's one-shot, ephemeral. So if you want to send a second file later, you have to repeat the tell-your-friend-a-code dance (with a new code). We have plans to leverage the first connection into making subsequent ones easier to establish, but no code yet. Incidentally, `wormhole ssh` is a subcommand to set up the ~/.ssh/authorized_keys file from a wormhole code, which might help get the best of both worlds, at least for repeated transfers.
- uhmpire 2y ago[dead]
- hypertexthero 2y agoExcellent, thank you! Setting this up on a PC and Mac to transfer files back and forth. There’s an XKCD for this, too: https://xkcd.com/949/ https://xkcd.com/949/
- onetimeuser1235 2y agoI've been using this for years. Also, GPU host Runpod uses it in their CLI tools to easily transfer large files to host.
- tarruda 2y agoI wonder if magic-wormhole could be implemented as a layer on top of Syncthing: - Generate a short code - Use the code as the seed to deterministically generate a Syncthing device key + config Since the Syncthing device key could be generated deterministically, sharing the code with both sides would be enough to complete a dir/file transfer and then discard the keys.
- jmakov 2y agoCan it also generate a link so the client can just ckick on it instead of having to install things?
- lotharrr 2y agoAlas no. It's a one-shot file-transfer tool, and we don't store a copy of the encrypted data or anything. So the sender must stay running until the receiver has finished downloading. If you're comfortable with relying on servers for your security, then I believe wormhole.app offers the clickable zero-install link that you described. Magic-wormhole can't use that approach, because our security model rules out reliance on servers for confidentiality or integrity. We could safely store ciphertext without violating the model, but you need an interactive protocol with the sender to get the decryption key (otherwise the wormhole code would be a lot larger), so it wouldn't improve the experience very much, and would cost a lot more to operate. The wormhole servers have trivial storage requirements, so the only real costs are bandwidth for the transit relay helper, for when the two sides can't make a direct connection.
- SushiHippie 2y agoIt's actually possible via https://winden.app https://winden.app which uses the wormhole protocol (compared to wormhole.app which is not affiliated with the matic wormhole project), once you upload a file there it will show you a link which is basically winden.app/#passphrase As it uses the anchor tag # the passphrase doesn't even get sent to the server hosting the website, so it all happens client side.
- Arubis 2y agoMagic wormhole is a lifesaver for getting config files onto locked-down corporate machines.
- dang 2y agoRelated: Magic Wormhole: Get things from one computer to another, safely - https://news.ycombinator.com/item?id=27262193 https://news.ycombinator.com/item?id=27262193 - May 2021 (178 comments)
- aftergibson 2y agoThis is one of those amazing single feature utilities that does one thing incredibly well and goes completely unnoticed as it’s so good but also unremarkable. I should try to be more grateful for these brilliant creations.
- j1elo 2y agoI'm reading so many good comments that I will be trying Magic Wormhole soon. How about Warpinator [1]? It's the application that I use simply because it came by default with my choice of Linux distro, and it works fine. Main use case for me is sending recently taken photos from my phone to the computer. [1]: https://github.com/linuxmint/warpinator https://github.com/linuxmint/warpinator
- justmarc 2y agoI wasn't yet planning for it, but what the heck. https://zynk.it https://zynk.it is a new project I've been working on together with a small team aimed at delivering a truly easy, fast, efficient, unlimited, privacy-respecting and pain free file-sharing experience. It’s peer-to-peer, E2EE and avoids centralized storage, aligning with the ethos of control and transparency we often discuss here. It allows users to send and receive any file(s) or folder(s) without any limits whatsoever between any device/OS and any device/OS, send and forget, Zynk takes care of all the heavy lifting. What I hope sets Zynk apart is that it is built to literally be used by anyone, be it a power user, or my mom. One of my main goals with this project is to remove any pains associated with data transfer once and for all, for any use case. I'm curious if this resonates with you—would you use it? What would make it indispensable for your workflows? I'd be happy to discuss it more if anyone is interested. Feel free to sign up for early access on the site.
- smusamashah 2y agoIt's login/email walled. If you do want people to try it, the try button shouldn't immediately greet you with a popup to provide your full name and email address. I stopped at that point.
- justmarc 2y agoPoint well taken. It was a bit too rushed and obviously not ready yet. I'll post about it once we finalize the site and make the whole value proposition clearer.
- samstave 2y agohrmph... Form no work on FF. Form only Works on chrome - but just gives me signup: https://i.imgur.com/ePcBVBE.png https://i.imgur.com/ePcBVBE.png Page has zero meat to the info... No screenshots, all cartoons. No talk of price/model/package/install/ etc... No confirmation email with info... Nice blurb - but needs work.
- justmarc 2y ago
- bredren 2y agoIs there a wrapper for wormhole that shares the phrase with a counterparty and their client auto requests it? I have a pal where we want this kind of auto accept style behavior.
- lotharrr 2y agoMagic-wormhole is really intended to help with the first-step "introduction" phase of a tool like that: start with two humans that can yell a codephase at each other, and finish with two computers that have a secure encrypted connection. Once you've got that connection, you can send whatever you want through it. The `wormhole send` tool is a good demonstration of what you can do with that API, and a convenient tool in its own right, but wasn't designed to be the end-all-be-all of the file transfer universe, nor to be a building block for other tools layered on top. The application you describe would be pretty cool (the UI might look more like dropping a file into a Slack DM chat window). But I'd recommend against using automated calls to `wormhole send` to accomplish it: you'd be cutting against the grain, and adding load to the mailbox server that everyone else uses. Instead, build a separate app or daemon, which can use the magic-wormhole API to perform just the introduction step. You'd push the "invite a peer" button on your app, it would display a wormhole code, you speak that to your pal, they push the "accept invitation" button on their app, type in the code, and then the two apps exchange keys/addresses. All subsequent transfers use those established keys, and don't need to use the wormhole code again. You should never need to perform a wormhole dance more than once per peer.
- TZubiri 2y agoObligatory xkcd https://xkcd.com/949/ https://xkcd.com/949/
- philipwhiuk 2y agoThe comments here reminded me more of https://xkcd.com/937/ https://xkcd.com/937/
- zzo38computer 2y agoTo send a file from one computer to the other by internet (although often internet should not be needed for this), I think netcat should do. Use tar or something else like that if you want to send multiple files. Use programs to calculate the hash if you want to verify the hash of the file. For large files, it does help to make resumable transfer; fortunately, that can be done easily, too (you can see what the file size is and use the "tail" program to skip some). You should not need HTTP, FTP, etc. You should be able to use something which can work on any computers, such as just TCP/IP. Unfortunately, some systems (especially some Windows systems) will make that difficult. Using the more complicated such as Magic Wormhole and other programs means you will need two computers that support such a thing. I did once try to transfer a file from Windows to Linux, and had to install ncat to do so but Windows deletes it by default if you try to do that, but I was able to make it to not to do that.
- loloquwowndueo 2y agoHow do you transfer between computers behind NAT or firewalls without an intermediary? If you have to install software anyway why not install wormhole directly? Netcat works in some circumstances and it’s fine to use it in those. But wormhole covers different scenarios and your netcat proposal doesn’t cover or have advantages in some of them.
- zzo38computer 2y agoIt is unfortunate that you would have to install netcat on Windows (I don't know why they don't include functions such as that built-in, perhaps it could be included as a function in PowerShell); but on some other systems it is likely to already be installed, and such a thing really ought to be included by default if the computer has TCP/IP included by default. This does not necessarily need to be netcat; it can be any program that does the same thing, and it is simple enough to include with TCP/IP based systems that other kinds of operating systems could potentially have their own variant, if they have the ability to connect to the internet. However, it is true about considering NAT. Then you will need to set up the intermediary (which further affects compatibility), if you cannot connect the computers directly (which also ought to be possible with a null modem cable, but that also is often not available). It also does not consider multiple files at once; how that should need to be handled will be different on different computers anyways though, since the files are different on a different computers. Due to such things, other programs such as Magic Wormhole might help, although even then it will not necessarily work with all computers anyways, because then you will need a computer that is compatible with Magic Wormhole. Another alternative, that might sometimes be suitable, would be LAN connections. This is not always suitable, but if they are, then you can use the LAN addressing directly, too.
- Obscurity4340 2y agoWhat do all the brilliant folk here think of Resilio Sync?
- annoyingnoob 2y agoI feel like this project could use a diagram. Maybe I'm a visual learner. I looked at the github link and the docs. It mentions that is uses a couple of servers. Without reading through the Installation steps I didn't grok how it works. A simple diagram with a couple of endpoints and how they connect would go a long way.
- malkosta 2y agoI have a friend who is not tech savvy at all. And I need him to send me a huge file. Is there any GUI frontend for this?
- bentley 2y agoWormhole William provides an APK: https://github.com/psanford/wormhole-william-mobile/releases/tag/v1.0.10 https://github.com/psanford/wormhole-william-mobile/releases... On Windows and Linux, there’s RiftShare which has a gui: https://riftshare.app/ https://riftshare.app/
- xeanotods 2y agoI almost lost a job for using this at work. Still not sure how they detected it.
- randomgiy3142 2y agoYou’re setting up a relay using two well known domain names it seems. And you’re encrypting files that probably can’t be decrypted using MITM so you’re sending all kinds of “red flags” if they use any number of MITM detection software. To be fair our offshore team was so bad with security (“doesn’t work? Turn it off!”) it is unfortunately necessary. If I had a slightly different app “magick wormhole” they’re likely to use it if it had a pretty GUI. Like if we didn’t have strict security policies in place how do you manage 500+ “developers” who have no repercussions? Part of it is getting the cheapest labor possible, part of it is security is hard to do right and part of it is english as a second language issue. It is much easier to put everyone in an incredibly locked down environment than it is to have them decide what’s secure or not. If I were to fork this and internally use our own DNS and put a GUI wrapper and there’s a flaw in the implementation of magic wormhole I’d be in much more trouble than using Crowdstrike which no one will get fired for using for example.
- mynameisash 2y agoI don't recall where I saw it (either the Python or Rust implementation, most likely), but there was talk about trying to turn this into a browser plugin. I would love to be able to use my browser to send files to someone else (via their browser, if they so choose).
- lotharrr 2y agoI don't know of one yet, but I tried to choose protocols (websockets) that were friendly to being hosted in a browser, or a browser plugin. The exception is the bulk-transfer protocol, that's pure TCP, which can't be used by plan web content, although I think browser plugins might be allowed to. The upcoming Dilation protocol should be more flexible on this dimension.
- catalypso 2y agoNot magic-wormhole compatible, but saw these shared on other comments: - https://wormhole.app https://wormhole.app - https://sendfiles.dev https://sendfiles.dev - https://file.pizza https://file.pizza - https://winden.app https://winden.app
- XorNot 2y agoI've been running Pairdrop - https://pairdrop.net/ https://pairdrop.net/ on my home network and it works great to let my wife out visitors easily share files off phones or laptops when you need a GUI.
- archgoon 2y agoJust wanted to say thank you to the maintainer and creator of magic wormhole. I had to help my nephew debug what had happened to his computer which didn't have any gui after a restart. Setting up magic wormhole to send files back and forth was a feasible solution over the phone.
- emrah 2y agoIs it better or more appropriate than rsync in certain use cases?
- Sesse__ 2y agoBetter than rsync (over SSH): - You do not need an existing trust relationship (or trust on first use) - Easier to punch holes through NAT/firewalls - Easier for non-technical users Worse than rsync (over SSH): - Multi-file support is poor (basically it .zips up everything before even starting to transfer) - Zero support for incremental transfers - Cannot reuse existing trust relationships (and thus cannot be used non-interactively) - Easier DoSed - 1/65536 chance of connection being hijacked (by default) - Higher CPU usage
- HoyaSaxa 2y ago> The codes are short and human-pronounceable, using a phonetically-distinct wordlist. The receiving side offers tab-completion on the codewords, so usually only a few characters must be typed. How does this work from a security perspective? Given the lack of apparent entropy can’t a malicious actor conceivably enter the correct phrase before the good actor?
- bentley 2y agohttps://en.wikipedia.org/wiki/Password-authenticated_key_agreement https://en.wikipedia.org/wiki/Password-authenticated_key_agr... “An important property is that an eavesdropper or man-in-the-middle cannot obtain enough information to be able to brute-force guess a password without further interactions with the parties for each (few) guesses. This means that strong security can be obtained using weak passwords.”
- lotharrr 2y agoThe PAKE algorithm lets you spend an interactive roundtrip to buy a full-strength key out of a weak shared secret. An attacker can attempt to guess the passphrase, and their chances are non-zero (one out of 65536 with the default configuration), but when they guess wrong, the whole protocol shuts down, and the real participants have to start over again, with a new code. So the only way for the attacker to win is for you to restart over and over again until they get lucky. Kinda self-limiting that way :). https://github.com/magic-wormhole/magic-wormhole/blob/master/docs/attacks.rst https://github.com/magic-wormhole/magic-wormhole/blob/master... has a larger writeup.
- upofadown 2y agoAn attack on the PAKE would involve the attacker seeing the secret value as it was transferred to the recipient and then beating the recipient to the handshake. So there is security value in being prompt in putting in the secret value at the receiving end. That is as opposed to sending a public key or key fingerprint. In that case there would be little value to the attacker in seeing the transfer. They would have to MITM the transfer of the key itself. If you wanted to prevent the attacker from sending bogus files you would also have to transfer some sort of signing key. So a short, time limited, secret vs a longer public value.
- jedisct1 2y agoAlso Piknik: https://github.com/jedisct1/piknik https://github.com/jedisct1/piknik The first thing I install on any new computer.
- menzoic 2y agoAutocompleting secrets sounds unsafe. > The receiving side offers tab-completion on the codewords, so usually only a few characters must be typed.
- danieljacksonno 2y agoI had the same reaction. It's a one time password, so it does not need to be as secure as a permanent one, but it still feels silly to have a long password that you can just type the first few characters and have it auto complete each word, versus just having a shorter password to begin with. That said I can see how autocompleting from the first three letters of each word for "beaver-grass-hypocondriac-shelf" might be easier for a human than typing "beagrahypshe"
- azornathogron 2y agoI don't think auto-completing a code-word leaks any information, since the set of code-words is fixed. Just think of each word as being one character from a large-ish alphabet. Code-words are used so that the one time secret can be easily remembered or shared over a voice channel.
- lotharrr 2y agoCorrect. The wormhole code is a channel number (called a "nameplate") and a short secret, which defaults to 16 bits of entropy. The secret is used as the input to a PAKE, which only gives the other party (hopefully your intended recipient, but maybe an attacker) a single guess. The security of the protocol stems from the PAKE algorithm: yes, someone might jump into your conversation and attempt to guess the secret, but they're going to guess it incorrectly most of the time, and each time they fail, the connection is interrupted, and you (the sender) get an error. You'll probably give up well before they get a reasonable chance of success. The secret can be any string you like, the protocol doesn't care, instead of "4-purple-sausages" it could be "4-65535" or "4-qtx", and have the same resistance to attack. The CLI encodes the secret as two words from the PGP word list, which was designed to be spoken and transcribed accurately even over a noisy voice channel (sort of like the Alpha/Bravo/Charlie/.. "military phonetic alphabet", except it's two alternating lists of 256 words each). In practice that pair of words is much easier to speak and listen and hold in your head for a minute or two than a random number, or the first two letters of each word divorced from the words themselves. There are some provisions in the protocol (not yet implemented) to allow alternate word lists, so if the sender uses e.g. a French wordlist instead of the default English one, the receiving CLI learns about it early enough so that "wormhole rx" can auto-complete against the correct list. The server/attacker could learn which wordlist is in use, but still faces the same level of entropy about the PAKE secret itself.
- lazyeye 2y agoSlightly off-topic but this explainer article on how TailScale traverses NATs/firewalls is interesting. Tailscale fools both endpoints into believing they are initiating the same network connection simultaneously enabling direct connection between 2 endpoints that would otherwise be impossible. https://tailscale.com/blog/how-nat-traversal-works https://tailscale.com/blog/how-nat-traversal-works
- royjohnson 2y ago[dead]
- meindnoch 2y agoDoes it work without an Internet connection?
- lotharrr 2y agoNope. It needs to contact the "mailbox server" to coordinate the rest of the protocol. Two machines with local connectivity (e.g. on the same LAN, but your WAN connection is broken) could still implement the second half of the protocol, where they use each other's IP addresses to make a direct connection, but without the first half they couldn't learn those addresses or exchange the key-negotiation messages. We've sketched out some approaches to working in a disconnected environment like that, using local multicast and mDNS/ZeroConf/Bonjour to act as an alternate mailbox server (https://github.com/magic-wormhole/magic-wormhole/issues/48 https://github.com/magic-wormhole/magic-wormhole/issues/48). There's still design work needed, though, and I fear it would degrade the experience for fully-connected nodes (extra timeouts), so it might want to be opt-in with a `--offline` flag on both sides.
- scirob 2y agoold but gold use it on the regular. Only thing that could be improved is an option for someone receiving the file to open it up on a website. file.pizza used to do this
- lostbeginner0x0 2y agoI'm inexperienced and I see a lot of posts like this where open-source that's seemingly loved by the community just don't get the support that they seem to need to survive for a long time. Why aren't people who know about this and hold important positions doing something about the ecosystem? What can people with no experience but care do to ensure the longevity of open source tools like this?
- ruph123 2y agoIf the devices are on the same network I prefer LocalSend. It is cross-platform and there are phone apps. Works very well: https://localsend.org/ https://localsend.org/
- scosman 2y agohttps://www.sharedrop.io https://www.sharedrop.io (source: https://github.com/szimek/sharedrop https://github.com/szimek/sharedrop) is a great user friendly option as well. I use it with friends, and even between VMs on the same machine.
- magnio 2y agoProps to sharedrop, very convenient and fast. They also support machines on different network, though I'm not sure how.
- deleted 2y ago[deleted]
- afh1 2y agoWhat ever happened with just setting up ssh or sftp?
- pluto_modadic 2y ago"I don't get why people use syncthing, can't they use bluetooth file transfer and USB cables like us oldschool peeps?" read the doc. SSH requires previous arrangement (you need to transfer the SSH key to your friend), magic wormhole is a way to arrange such a meeting without physical proximity. or requires typing a password into a phone.
- bakkoting 2y agoIf you already have node and npm installed, and are happy running random binaries from the internet, you can `npx magic-wormhole` to run this without any further setup. It just wraps wormhole-william, which is the go implementation of magic-wormhole. I put it on npm primarily so I could send things to other JS developers an absolute minimum of fuss: one command, total, instead of installing a tool and then running the command.
- yownie 2y agoDo I understand correctly from this thread that there's still no good one reliable way to send files across networks where both participants are NAT'd ? What about using Onionshare to solve NAT'ing or at least Topr for handshaking?
- fragmede 2y agoReliability is fine, performance is, depending on your demands, not. F the coordination server is not up to task of matching throughput of the two servers, and a lot of bytes need to be transferred, then it's noticable. But the tech at large works, depending on the implementation you choose to use. (I'm partial to Tailscale, although that's a different service, it lets me transfer files between computers (with additional SW) without manually mapping a port. They are using DERP for the coordination server.
- lotharrr 2y agoWebRTC (and the various hole-punching techniques listed elsewhere here) have mechanisms to help with most cases of both participants living behind NAT boxes. The remaining cases require some sort of relay that is willing to proxy the connection through the extra-strict NAT layers. Tor is basically a distributed set of proxy servers, so using onion servers (aka Hidden Services) is a viable, albeit somewhat slow, way to manage even the strict NAT boxes. If you have Tor installed, then `wormhole send --tor` will automatically use an onion service to do exactly that.