2 ms·

Software moving the mouse cursor is only acceptable when the window is full-screen. If the user makes an application go full-screen, they are opting out of the

by mrob 5mo ago

Software moving the mouse cursor is only acceptable when the window is full-screen. If the user makes an application go full-screen, they are opting out of the normal desktop UI conventions. It's expected that full-screen software completely takes over the UI, and there are legitimate uses for moving the mouse cursor in full-screen software, e.g. centering an invisible cursor every frame in a first-person shooter game so endless view rotation is possible. But if it's windowed then it should be impossible.

LatencyKills 5mo ago
> But if it's windowed then it should be impossible. I worked on several apps for the visually impaired that automatically move the mouse cursor to different UI elements in the front-most application, regardless of the window state. It’s a good reminder that “impossible” often just means “I haven’t accounted for that use case yet.”
- mrob 5mo ago
  If it's part of the OS's standard accessibility framework then it's acceptable. The important point is that applications shouldn't be able to arbitrarily move the mouse in situations when it's unexpected.
  - LatencyKills 5mo ago
    > The important point is that applications shouldn't be able to arbitrarily move the mouse in situations when it's unexpected. That is quite a different statement from "It should be impossible." What should be impossible is for the OS to prevent this type of usage when it is clearly useful. Beyond accessibility, I use these features to automate testing of native macOS GUI apps.
  - yjftsjthsd-h 5mo ago
    Coming from Linux, the accessibility framework is just another series of programs. My main a11y program is a tiny little binary that uses the keyboard to move the mouse around at will; I certainly don't want the system to try and restrict that.
  - piekvorst 5mo ago
    You are arguing for uniformity. It does make a lot of sense: the global UI makes a considerable effort to build a single perfect UI, but that can only work if the apps actually make use of it. But why shouldn’t the global UI itself make use of mouse warping?
amenghra 5mo ago
Blender (3D modeling & animation software) implements this cool thing when rotating/resizing objects: if the mouse cursor moves out of the window it reappears on the other side (enabling resizing/rotating ad infinitum).
- mrob 5mo ago
  I think a better way to implement that feature would be a mechanism for programs to temporarily enable off-screen mouse cursors. This should also track the position where the cursor would be if it had been clipped to the screen boundary as normal, and immediately return the cursor to that position when the off-screen mode ends. Note that the OS returns the cursor, not the application, so applications can't abuse this mechanism for repositioning the cursor.
  - spider-mario 5mo ago
    I don’t find that better. Why would it be? Now you don’t see the correlation between the movement of the cursor and its in-app effect.
    - mrob 5mo ago
      It's better because it's the minimum change to mouse cursor behavior that allows the feature to work. You don't need to see the cursor while it's off-screen because the point is manipulate the 3D object, and you can look at the 3D object instead. The same is true for things like controls in an audio DAW which might also benefit from off-screen mouse movement. If there's really a case where you need to see the exact position of the cursor while it's off-screen, you could display it wrapped around only while it's actually off-screen. But this would potentially confuse new users, so it should be optional and disabled by default.
      - spider-mario 5mo ago
        > You don't need to see the cursor while it's off-screen because the point is manipulate the 3D object, and you can look at the 3D object instead. Disagreed. Seeing the cursor at all times gives you some point of reference, and once you release the tool, you know where your cursor is. > If there's really a case where you need to see the exact position of the cursor while it's off-screen, you could display it wrapped around only while it's actually off-screen. I don’t understand what this means. If it’s not off-screen then it’s automatically also not wrapped around. > But this would potentially confuse new users, so it should be optional and disabled by default. This presumes that “cursor is suddenly allowed to be off-screen and not visible” is less confusing.
Grom_PE 5mo ago
I generally never want programs to go fullscreen because I like to keep taskbar shown, so I can keep track of time, notifications and whatnot. Well designed video games that rely on fast and precise mouse input capture the cursor during the gameplay until menu is shown. The only times I have to go fullscreen is for the games that fail to capture the cursor and where accidentally clicking outside of the game window leads to a loss. Can't imagine a non-game program other than a video player that I would want fullscreen.
Ukv 5mo ago
> But if it's windowed then it should be impossible. I have one monitor, so fairly often have games/editors windowed with something else alongside them (a video, documentation, …). There are also uses where the mouse is only captured temporarily - like FPS-controls flying mode in Godot and Blender. Some image editors also allow for things like moving the cursor with arrow keys, which I find useful.

by mrob 5mo ago

LatencyKills 5mo ago

> But if it's windowed then it should be impossible. I worked on several apps for the visually impaired that automatically move the mouse cursor to different UI elements in the front-most application, regardless of the window state. It’s a good reminder that “impossible” often just means “I haven’t accounted for that use case yet.”

mrob 5mo ago
If it's part of the OS's standard accessibility framework then it's acceptable. The important point is that applications shouldn't be able to arbitrarily move the mouse in situations when it's unexpected.
- LatencyKills 5mo ago
  > The important point is that applications shouldn't be able to arbitrarily move the mouse in situations when it's unexpected. That is quite a different statement from "It should be impossible." What should be impossible is for the OS to prevent this type of usage when it is clearly useful. Beyond accessibility, I use these features to automate testing of native macOS GUI apps.
- yjftsjthsd-h 5mo ago
  Coming from Linux, the accessibility framework is just another series of programs. My main a11y program is a tiny little binary that uses the keyboard to move the mouse around at will; I certainly don't want the system to try and restrict that.
- piekvorst 5mo ago
  You are arguing for uniformity. It does make a lot of sense: the global UI makes a considerable effort to build a single perfect UI, but that can only work if the apps actually make use of it. But why shouldn’t the global UI itself make use of mouse warping?

amenghra 5mo ago

Blender (3D modeling & animation software) implements this cool thing when rotating/resizing objects: if the mouse cursor moves out of the window it reappears on the other side (enabling resizing/rotating ad infinitum).

mrob 5mo ago
I think a better way to implement that feature would be a mechanism for programs to temporarily enable off-screen mouse cursors. This should also track the position where the cursor would be if it had been clipped to the screen boundary as normal, and immediately return the cursor to that position when the off-screen mode ends. Note that the OS returns the cursor, not the application, so applications can't abuse this mechanism for repositioning the cursor.
- spider-mario 5mo ago
  I don’t find that better. Why would it be? Now you don’t see the correlation between the movement of the cursor and its in-app effect.
  - mrob 5mo ago
    It's better because it's the minimum change to mouse cursor behavior that allows the feature to work. You don't need to see the cursor while it's off-screen because the point is manipulate the 3D object, and you can look at the 3D object instead. The same is true for things like controls in an audio DAW which might also benefit from off-screen mouse movement. If there's really a case where you need to see the exact position of the cursor while it's off-screen, you could display it wrapped around only while it's actually off-screen. But this would potentially confuse new users, so it should be optional and disabled by default.
    - spider-mario 5mo ago
      > You don't need to see the cursor while it's off-screen because the point is manipulate the 3D object, and you can look at the 3D object instead. Disagreed. Seeing the cursor at all times gives you some point of reference, and once you release the tool, you know where your cursor is. > If there's really a case where you need to see the exact position of the cursor while it's off-screen, you could display it wrapped around only while it's actually off-screen. I don’t understand what this means. If it’s not off-screen then it’s automatically also not wrapped around. > But this would potentially confuse new users, so it should be optional and disabled by default. This presumes that “cursor is suddenly allowed to be off-screen and not visible” is less confusing.

Grom_PE 5mo ago

I generally never want programs to go fullscreen because I like to keep taskbar shown, so I can keep track of time, notifications and whatnot. Well designed video games that rely on fast and precise mouse input capture the cursor during the gameplay until menu is shown. The only times I have to go fullscreen is for the games that fail to capture the cursor and where accidentally clicking outside of the game window leads to a loss. Can't imagine a non-game program other than a video player that I would want fullscreen.

Ukv 5mo ago

> But if it's windowed then it should be impossible. I have one monitor, so fairly often have games/editors windowed with something else alongside them (a video, documentation, …). There are also uses where the mouse is only captured temporarily - like FPS-controls flying mode in Godot and Blender. Some image editors also allow for things like moving the cursor with arrow keys, which I find useful.