3 ms·
I wonder if AI screen readers will ever use the visual appearance of something to determine what it means. So even if you draw on a `<canvas>` it can still read
by renewiltord 4y ago
I wonder if AI screen readers will ever use the visual appearance of something to determine what it means. So even if you draw on a `<canvas>` it can still read the text. That would be sick.
- z3c0 4y agoYou have a fantastic idea there, and if you'd like to attempt to make it a reality, I'm happy to brainstorm it with you. You keep full ownership of the concept; I'm happy to contribute given the people it'd help. You can contact me directly using my handle at my domain, which is 21337.tech
- renewiltord 4y agoz3c0, much appreciated, but I am prioritizing other things at this time. Let me hit you up at a future time if no one has already built something with this feature already!
- z3c0 4y agoFine by me! We'll table this for then.
- mywittyname 4y agoBetter to use a div instead.
- z3c0 4y agoMore than just a witty name, I see
- suby 4y agoI feel that this is where accessibility needs to go. We cannot rely on toolkits to implement support for accessibility standards because there will always be people building apps in niche toolkits / homemade gui's which don't support accessibility, especially as wasm becomes more common on the web. We need to treat the screen like a PNG which an AI can parse to determine what the text is, what text is relevant to read to the user, where and what the buttons are, how to emphasize reading the text based on the visuals, etc. It's the only thing that will scale and while difficult it seems that creating something like this is within reach.
- layer8 4y agoI agree in principle, but good luck with AI interpreting flat-UI controls visually, it’s confusing enough for sighted users. This actually gives me a little hope that AI-interpreted UI could trigger a trend back to visually obvious and unambiguous controls.
- madeofpalk 4y agoNo. That’s like saying OS should use AI to try and figure out what buttons are to make them clickable, rather that developers actually building an interface for users. All operating systems and platforms have pretty fluent and in-depth APIs for exposing an “accessibility tree” for assistive technologies to use. It’s your responsibility as a developer to build interfaces for actual users, and there’s very little reason not to.
- ronsor 4y ago> That’s like saying OS should use AI to try and figure out what buttons are to make them clickable, rather that developers actually building an interface for users. That's actually a really good idea.
- maxwelljoslyn 4y agoEspecially now that designers are making buttons/clickable areas hard to distinguish ... I could totally use AI to highlight all the things that are actually, you know, interactive.
- nirimda 4y agoYou don't need an AI to do this, just make your own custom build of whatever operating system you use with styles that aren't crap. It's almost certainly a more tractable task than trying to make an AI work out what the interactive bits are - considering it seems to be a business objective for many companies nowadays to make it hard to work out what the interactive bits are.
- 4y ago
- cxr 4y agohttps://hn.algolia.com/?query=donhopkins%20morgan%20dixon&sort=byPopularity&type=comment https://hn.algolia.com/?query=donhopkins%20morgan%20dixon&so...
- warpech 4y agoThis is fascinating. Do you know what ever happened to these projects? Prefab[1] and especially Bubble Cursor [2] look like be super useful additions for the flat-UI era. [1] http://prefab.github.io/ http://prefab.github.io/ [2] https://www.tovigrossman.com/BubbleCursor/ https://www.tovigrossman.com/BubbleCursor/
- rikroots 4y agoIn my view all canvas-related JS libraries should treat accessibility as a foundational requirement. It's not "too difficult" to implement. Here's an explanation of the accessibility features I've added to my canvas library[1]. These features may not be the best approach, or even the most appropriate approach ... but at least they're there, and they can evolve into something better as/when people offer feedback. [1] - https://scrawl-v8.rikweb.org.uk/learn/eleventh-lesson https://scrawl-v8.rikweb.org.uk/learn/eleventh-lesson