12 ms·
How Universal Control on macOS Monterey Works
- ricokatayama 5y agothat's a great feature. I really love my iPad, but changing the workflow to operate both systems is overwhelming. I can imagine myself using Universal Control everyday.
- handrous 5y agoI've found the iPad to be a great place to isolate shitty, resource-hogging communication software (ahem, Slack) to a dedicated shitty-software-I-must-nonetheless-have-open-all-the-time console. This makes that practice even better, with the unified control and drag & drop and all that.
- cabalos 5y agoAgreed. This is going to be my exact use case for Universal Control.
- kergonath 5y agoYeah, the iPad is a great container for terrible software. No worries about Zoom backdooring your computer and leaving stuff all over the place. I don’t really need unified control for this, though. The iPad just sits nicely on the desk for however long the stupid meetings are, and these apps are not interactive enough for having to lift a hand to be much of a pain.
- silvestrov 5y agoMore and more gestures you don't know about as a normal user. Where is the "all the gestures" instruction manual from Apple?
- whatch 5y agoDemos in trackpad settings were quite informative for me. Also, aren't there notifications with change notes when you upgrade? Maybe something changed in Big Sur, I only used old MacBook Air up to Catalina.
- reaperducer 5y agoThere's the Tips app for iOS and iPadOS devices.
- jws 5y agoWhere is the "all the gestures" instruction manual from Apple? They would be in the users' wastebaskets with all the other paper shipped with the product. There were interactive onboarding tutorials during install or upgrade, but pretty much everyone clicked spastically at them until they went away without reading them. No one reads manuals. I have shipped a (admittedly low volume) game where I have never detected a user reading the help pages I slaved over. The prominent help icon never gets touched. I made an introductory tutorial which animatedly draws prettily curved highlighter arrows and circles on the screen to explain the important user interface elements… click click click… the new users do everything they can to close it and get it off the screen without reading it. Search: "ipad gestures site:apple.com" Search: "macos gestures site:apple.com" The top hits for both of your questions, as translated into google-ese, are the documents you want, with the exception of iPad multitasking, but that's a deliberate decision by Apple. Should be resolved in iOS 15 when they finally expect regular people to maybe use multitasking.
- reaperducer 5y agoThey would be in the users' wastebaskets with all the other paper shipped with the product Apple products ship with almost no paper these days, and haven't for a good number of years. Usually it's just regulatory certificates and a quick setup leaflet with a link printed on it for the full manual, which nobody ever reads, with predictable results.
- toxik 5y agoI think that’s exactly the point the GP was making.
- DonHopkins 5y agoThey're IN the computer! https://www.youtube.com/watch?v=L_o_O7v1ews https://www.youtube.com/watch?v=L_o_O7v1ews https://www.youtube.com/watch?v=Sj5HdGjvXcE https://www.youtube.com/watch?v=Sj5HdGjvXcE https://www.youtube.com/watch?v=H2uHBhKTSe0 https://www.youtube.com/watch?v=H2uHBhKTSe0
- zepto 5y ago> More and more gestures you don't know about as a normal user. I see this complaint quite a bit, but it doesn’t make sense to me. Of course there are more and more features, and of course most people don’t know about most of them because there are so many. > Where is the "all the gestures" instruction manual from Apple? If you want to know about the new gestures, Apple demonstrates them during keynotes whose sole purpose is to announce them. They are covered internationally by pretty much all of the technology press. As others have pointed out, there are in fact many places where Apple documents them too.
- FireBeyond 5y ago> If you want to know about the new gestures, Apple demonstrates them during keynotes whose sole purpose is to announce them. I get your next point about documentation, but if you think saying I have to watch a 90 minute marketing presentation to learn about gestures is some kind of obvious or reasonable expectation? No thanks.
- zepto 5y ago> saying I have to watch a 90 minute marketing presentation It is literally nothing but an explanation and demonstration of new features. It’s obvious that if you want new features to be demonstrated to you, you are going to need to watch a demonstration. If you don’t, then you can read the documentation or ask your friends. The complaint that nobody is telling normal users about these features makes no sense.
- nxc18 5y agohttps://support.apple.com/en-us/HT204895 https://support.apple.com/en-us/HT204895 They’re also good about giving a “what’s new in Big Sur” notifications after upgrade and as part of the OOBE iirc. Can’t be restarted from what I can find, unfortunately. Tips app is great for iOS.
- bengale 5y agoGo to the trackpad page in settings and it will show you with little animations.
- bengale 5y agoThis is so great. I have a keyboard that I switch Bluetooth to control my iPad a lot during the day so this will make things easier.
- least 5y agoI've used the software Synergy [1] in the past as a software based KVM which has the advantage of being cross-platform with linux and Windows. It works fairly well but some of the features that Apple is promising with Universal Control are ones that Symless has struggled to deliver in their product, probably due to the fact that they don't control the entire stack like Apple does. They've promised drag and drop, copy and paste, and other features between systems but it seems that they've stopped advertising them as upcoming features. Universal Control stood out to me as one of the more interesting ones of the WWDC keynote and one that I could see myself using, but am a tad skeptical it'll deliver on its promise fully. Apple's other continuity features are remarkably useful and great when they work, but in the cases that they don't (which while not normal, isn't uncommon enough to say they're a non-issue) it can be a real pain. This sort of feature needs to be rock-solid if you intend to integrate it into your personal workflow. [1] https://symless.com/synergy https://symless.com/synergy
- AshamedCaptain 5y agosynergy1 already has both drag and drop and copy and paste and I use those daily. However DnD doesn't seem to work between GNU/Linux and anything else.
- nanidin 5y agoCopy/paste works for me between Windows and Mac in Synergy.
- caymanjim 5y agoWorks flawlessly with no special setup between Windows, MacOS, and Linux.
- adrusi 5y agoApple technologies in general are great when they work, but entirely impervious to troubleshooting.
- ed_balls 5y ago
- defaultname 5y agoImmediately setup my iPadOS 15 iPad beside my macOS 12 M1 machine....and it didn't work. At the time there were a couple of brief articles saying just move the mouse off the edge of your screen. They haven't released this technology yet, so we can't test it out. Just an FYI to anyone who looks to try it out. As an aside, I have a Mac Mini beside a MBP in my normal setup. My BT keyboard and mouse are connected to the mini. I wish I could do this as easily to jump between machines.
- twobitshifter 5y agoThis article says 3 devices are supported and uses an example of iPad MacBook and iMac - so I think it will cover you, unless it’s m1 only. https://petapixel.com/2021/06/07/apples-universal-control-seamlessly-links-multiple-devices-together/ https://petapixel.com/2021/06/07/apples-universal-control-se...
- pohl 5y agoFor comparison, Sidecar didn’t work for me until late in the beta cycle. I think it was the last public beta where I finally got it to work. Ultimately I could never get in the habit of using Sidecar because it turns out I have to VPN into work, thwarting Sidecar altogether. I expect VPN to prevent me from using Universal Control too.
- reaperducer 5y agoI'm not sure I understand the difference between Sidecar and Universal Control. Is UC just Sidecar for more screens? (FWIW, I use Sidecar every day and it works really well.)
- pohl 5y agoWhat makes them similar is that the two machines need to be able to communicate with each other. The difference is that one turns the iPad into a display for the computer, while the other turns the computer into a keyboard & mouse for the iPad. I imagine VPNs will interfere with both. Sidecar works great for me, too. I just have no occasion to use it where I’m not on VPN.
- mrkstu 5y agoThe cost of a Magic Keyboard cover for an iPad Pro becomes much more tolerable if it can serve as the main input for multiple devices. Makes an iPad/Mac Mini combo pretty compelling.
- ianwalter 5y agoYes! I've tried out way too many keyboards in the last few years and the Magic Keyboard is by far my favorite. I'm not as big of a fan of the trackpad but before this announcement I spent a lot of time trying to figure out how I could use the Magic Keyboard with my Mac Mini.
- holman 5y agoI'm a pretty big fan of it, too. Kind of like that bouncier rubberized feel. That said... it really needs an escape key, hah.
- 1123581321 5y agoYou can map caps lock to escape. Settings, Keyboard, Hardware Keyboard, Modifier Keys. Unfortunately the system and many apps still aren’t expecting escape input in places they should be.
- camillomiller 5y agoWell, it’s only the mac’s mouse and keyboard that can control the iPad and not viceversa
- dagmx 5y agoiPads can already sort of control a Mac via Sidecar. Not entirely the same thing but it's there.
- camillomiller 5y agoAsked Apple “on background” about this. They confirmed it’s only the Mac that can control other devices with its peripherals
- aye01 5y agoLogitech MX product have had this feature for a while now and its even cross platform. its called Logitech Flow and works almost as seamlessly as that mac demo. Only difference would be installing the Logitech Options app vs it being native. Seems like a great feature if you're fully in the Apple ecosystem.
- jreese 5y agoThat doesn't support the iPad though, right?
- AshamedCaptain 5y agoAnd I'm going to guess that's because of Apple restrictions, anyway. Good luck getting past the App Store Review a program that tries to read and/or control the mouse pointer position. It's already hard enough to do a Synergy-like thing in Android, although technically still barely possible. I ponder if this is a new business model -- make a shitton types of applications outright impossible in the name of "security", then announce your own (proprietary) implementations of these types of applications that bind people to your brand of devices in order to encourage sales.
- toxik 5y agoNew? This is just market segmentation.
- kergonath 5y ago> Only difference would be installing the Logitech Options app Is that the app that wants to use all 8 cores and turn my iMac into a noisy space heater every now and then? I love Logitech’s hardware, but their software is consistently terrible.
- aye01 5y agonever had that happen before. as we speak, the app is running at 1% of a core and 100mb ram. id imagine that whatever apple implements uses some sort of protocol that wouldn't be free in terms of resources either.
- sneak 5y ago> First, you need to get the iPad and Mac relatively close to each other. Universal Control is built off the same Continuity and Handoff features that have long been a part of iOS and macOS. Bummer. This means that this will be an iCloud-only feature, most likely. (Apple seems to have no reluctance to this, as HomePods also require iCloud to set them up.) More pushes toward Apple services. :( It would be nice if I could use the full features of the OS/hardware I bought without having to engage with the privacy nightmare that is Apple's approach to network services.
- bengale 5y agoYes it requires iCloud.
- deleted 5y ago[deleted]
- smoldesu 5y agoAmen, I have no idea why you'd need iCloud to use... wireless KVM.
- ThePowerOfFuet 5y agoAuthentication and authorization.
- shadowtree 5y agoIt allows for file transfers via drag and drop - pretty sure it uses iCloud as the data cache inbetween.
- danappelxx 5y agoNow we just have to wait for Apple to add the reverse - control your Mac from your iPad :) This could be pretty useful bc of the touch screen + pencil combo. Back in 2016 I spent a weekend mocking up an "iPad as a graphics tablet" app, and it was surprisingly easy and effective [0][1]. I'm sure Apple could do a lot better. [0]: https://github.com/Danappelxx/iPadMouse https://github.com/Danappelxx/iPadMouse [1]: https://www.youtube.com/watch?v=tTHTx4MMwg4 https://www.youtube.com/watch?v=tTHTx4MMwg4
- kergonath 5y agoThere’s already Sidecar. It’s not quite what you want, but it’s a step in that direction.
- danappelxx 5y agoWow… I just assumed Sidecar was a second monitor, totally underestimated it. Bummer it only works on newer MacBooks!
- kergonath 5y agoYes, I think it relies on some features of a recent-ish Bluetooth version. To be fair, I never use it for something requiring complex input, but it’s nice for something like a movie, a music app, or something that runs in the background but you might want to have a glance at every now and then.
- tdonovic 5y agoBy newer macbooks, its just macbooks newer than 2015. The 2015s and earlier didn't have h265 encoders in hardware, and thus don't work properly. There is a hack you can install to force sidecar to run on earlier macs, but the latency and quality is terrible, partially because h264 is harder to shove over the wire than more compressed h256
- dmart 5y agoYeah, Sidecar is pretty cool. I was surprised to learn that even pressure-sensitivity from the Apple Pencil worked (at least in Blender where I tried it out.) It'd be nice if you could initiate it from the iPad side, though. There used to be a remote access feature built into iCloud called Back to my Mac, not sure why it was killed.
- seiferteric 5y agoI want to be able to use my iPhone apps on my Mac, can I do that? I have some apps that only work on my phone like my TV remote app and my RSA 2fa app that I often would like to access from my Mac.
- thrwn_frthr_awy 5y agoYou can do that with a M1 Mac.
- seiferteric 5y agosorry can you explain how?
- dkdbejwi383 5y agoFirst result via a search engine https://www.macrumors.com/how-to/install-any-ios-app-m1-mac/ https://www.macrumors.com/how-to/install-any-ios-app-m1-mac/
- seiferteric 5y agoAh I see, I have tried that, but the official roku remote app does not seem to show up for some reason and the RSA app I need can only be run in one place since it uses a unique key. I am thinking more about accessing the apps already on my phone like screen sharing or something.
- dkdbejwi383 5y agoDon’t think that’s possible without jailbreaking, sorry!
- ulzeraj 5y agoDeveloper needs to authorize his iOS app for it to be available on the MacOS App Store. There used to be a method to side load any iOS application (lots of people were using to play Genshin Impact) but Apple disabled that functionality in 11.3.
- danielyaa5 5y agoI wish they would just let me remotely login to my phone and tablet from my mac
- dkdbejwi383 5y agoUniversal Control looks interesting, but it also saddens me because it makes me think that target display mode will never be coming back.
- hcarvalhoalves 5y ago> Then, you start up Universal Control by dragging your mouse pointer all the way to the left or right edge of your Mac’s screen, then a little bit beyond that edge. When you do, the Mac will assume that you’re trying to drag the mouse over to another device, in this case the iPad. That's really clever! Users of multiple screens already know to do that, and that also makes users get used to treating other devices just like another screen.
- deleted 5y ago[deleted]
- roody15 5y agoThe fact that all devices have to be signed in and connected to same icloud account … makes this not quite as seemless IMO. For example work based or education based managed apple ID’s cannot use the universal control functionality. https://support.apple.com/guide/apple-school-manager/service-access-with-managed-apple-ids-apd435283f6b/web https://support.apple.com/guide/apple-school-manager/service...
- louissm_it 5y agoHow else would you do it though? Surely you don’t want a random Mac to push its cursor onto your iPad? Same with all the other handoff features. Maybe I’m missing something!
- makeitdouble 5y agoRight now it’s “the ‘seemless’ way or the highway”. As far as I understand they didn’t bother having alternative linking mechanism, like asking permission to the ipad though some other app or though safari for instance. If it’s the same as sidecar 2FA is also mandatory for it to work. It makes sense for the proverbial 80%, and leaves a sour taste for the rest.
- GoodDreams 5y agoWith Sidecar I was hoping that physically connecting the iPad to the Mac would be enough. Would a physical connection (with perhaps an additional prompt) be a sufficiently secure authorization alternative? Putting my opsec hat on: I suppose someone could (theoretically) use an adapter to tunnel USB/Thunderbolt through a wireless connection to work around the need for a physical connection.
- louissm_it 5y agoDidn’t think of that, good point!
- perryizgr8 5y ago> How else would you do it though? There are many ways. The simplest I can think of is a 6 digit numeric code that you have to enter, once from device A to B and then from B to A. The OS can also ask you to authenticate with your fingerprint before linking.
- pier25 5y agoAnyone remembers Teleport? It was an app for macOS that did the same thing 10 years ago. They released the source code a couple of years later: https://github.com/johndbritton/teleport https://github.com/johndbritton/teleport
- nreilly 5y agoApple hired that developer a long time ago
- wyuenho 5y agoFirst with AirDrop, then Continuity and Handoff, and now Universal Control, Apple's ubiquitous use of Bluetooth LE and Wi-Fi direct connections to devices sharing the same iCloud account makes me wonder how exactly does Apple secure all these over the air connections. Once hacked, an attacker presumably nearby can intercept phone calls and text messages, look what's in the clipboard, what website you've been browsing, where you've been, and now even what you are typing, all done remotely without the victim even noticing. I know there's an Apple Platform Security document, but that thing reads like marketing material rather than actually explaining what actually goes on under the hood. Has there been any serious attempts at breaking these things I wonder?
- DonHopkins 5y agoOne giant leap for Apple, and one small step for Userkind toward Ubiquitous Computing and the vision of the Xerox PARC Tab, Pad, and Board! Ubiquitous Computing Demonstration using Tabs, Pads and Boards from 1988 https://www.youtube.com/watch?v=o4_CcNLd2iE&ab_channel=LinusSuter https://www.youtube.com/watch?v=o4_CcNLd2iE&ab_channel=Linus... >In the 21st century the technology revolution will move into the everyday, the small and the invisible. Mark Weiser coined the phrase "ubiquitous computing" around 1988, during his tenure as Chief Technologist of the Xerox Palo Alto Research Center (PARC). Both alone and with PARC Director and Chief Scientist John Seely Brown. Weiser wrote "The Computer for the 21st Century" back in 1991. Ubicomp Tabs - Ubiquitous computing Xerox PARC https://www.youtube.com/watch?v=5ofehNpoSrY&ab_channel=LeonardoLins https://www.youtube.com/watch?v=5ofehNpoSrY&ab_channel=Leona... >Ubiquitous computing (or "ubicomp") is a concept in software engineering and computer science where computing is made to appear anytime and everywhere. In contrast to desktop computing, ubiquitous computing can occur using any device, in any location, and in any format. A user interacts with the computer, which can exist in many different forms, including laptop computers, tablets and terminals in everyday objects such as a fridge or a pair of glasses. The underlying technologies to support ubiquitous computing include Internet, advanced middleware, operating system, mobile code, sensors, microprocessors, new I/O and user interfaces, networks, mobile protocols, location and positioning and new materials. >This paradigm is also described as pervasive computing,[1] ambient intelligence,[2] or "everyware".[3] Each term emphasizes slightly different aspects. When primarily concerning the objects involved, it is also known as physical computing, the Internet of Things, haptic computing,[4] and "things that think". Rather than propose a single definition for ubiquitous computing and for these related terms, a taxonomy of properties for ubiquitous computing has been proposed, from which different kinds or flavors of ubiquitous systems and applications can be described.[5] >Ubiquitous computing touches on a wide range of research topics, including distributed computing, mobile computing, location computing, mobile networking, context-aware computing, sensor networks, human-computer interaction, and artificial intelligence. An Overview of the ParcTab Ubiquitous Computing Experiment. Roy Want, Bill N. Schilit, Norman I. Adams, Rich Gold, Karin Petersen, David Goldberg, John R. Ellis and Mark Weiser. http://www.roywant.com/cv/papers/pubs/1995-12%20(IEEE%20PCom)%20parctab.pdf http://www.roywant.com/cv/papers/pubs/1995-12%20(IEEE%20PCom... >6.3.1 Group Pointing and Annotation >A PARCTAB used as a pointing device operates much like a mouse. However, a PARCTAB does not have a cable and can use proximity in combination with its wireless link to connect to the nearest computer. Many PARCTABs can also connect to the same computer. Consider, for example, the case in which a lecture is presented using a large electronic display such as a Liveboard (see 2.2). Each tab in the audience can control a different pointer on the display. We have built a remote display pointer using the PARCTAB screen as both a relative and absolute positioning tool: the user controls the location and motion of the pointer by moving a finger over the PARCTAB’s touch surface2. >An extension of this idea is Tabdraw, a multi-tab application that allows the tab screen to be used as if it were a piece of scrap paper. One mode of use allows each PARCTAB participating in the application to access and draw on a shared piece of virtual paper. The shared drawing is generally defined by the room that people are in. A group in one room will automatically obtain a separate drawing surface from that in another room. Alternatively, a group might arrange to share a drawing regardless of location. [...] >6.4 Remote Control >Television and stereo system remote-controls have popularized the notion of control at a distance. In fact so many pieces of consumer electronics have such controllers that one can now buy universal remote controls that control many devices at the same time. A PARCTAB can also act as a universal controller. Furthermore, it can command applications that traditionally take their input from a keyboard or a mouse. >Since a tab can display arbitrary data, the controls available to a user can be changed depending on context. (Commercial universal remote controllers, in contrast, tend to need a large array of buttons.) Using the remote control application in an office may trigger a tab to provide a control panel that adjusts lighting and temperature, whereas in a conference room the interface might be biased toward presentation tools. >We have experimented with two types of remote control. First, program controllers providing a more powerful set of commands than was available in the original program. If a program is already intended for remote use and has a network interface, controlling it and extending it with a PARCTAB application is very easy. Second, another UbiquitousComputing project at Xerox PARC, the Responsive Environment Project [7], has been exploring how environmental control can save energy during the day-to-day operation of a building. The project had created servers that control power outlets through a commercial system called X10. The PARCTAB has been used to interface with these servers and thus control power appliances in the test area. Ubiquitous Computing: Tabs, Pads, Books, and Clouds https://lowendmac.com/ed/rosen/10ar/ubiquitous-computing.html https://lowendmac.com/ed/rosen/10ar/ubiquitous-computing.htm... >The iPad launch got me thinking about an old paper I'd once read about "Tabs, Pads, and Boards" and how small portable computers with different form factors were the direction technology was taking. Upon further review, it's amazing how well this model has held up over time. The paper was written - where else - at the famous Xerox PARC research facility, birthplace of the GUI, the mouse, and much of modern computing.