5 ms·
Ben Shneiderman recalled that "Tim told me at the time that he was influenced by our design as he saw it in the Hypertext on Hypertext project". Ben Shneiderma
by DonHopkins 5y ago
Ben Shneiderman recalled that "Tim told me at the time that he was influenced by our design as he saw it in the Hypertext on Hypertext project".
Ben Shneiderman wrote the following email to John Gilmore and I, in response to a question John asked me about the origin of the term "hyperlink" raised in a discussion on the Internet History mailing list. John then forwarded Ben's email to the Internet History mailing list, here:
https://elists.isoc.org/pipermail/internet-history/2020-April/005956.html https://elists.isoc.org/pipermail/internet-history/2020-Apri...
>My students conducted more than a dozen experiments (unpublished) on different ways of highlighting and selection using current screens, e.g. green screens only permitted, bold, underscore, blinking, and I think italic(???). When we had a color screen we tried different color highlighted links. While red made the links easier to spot, user comprehension and recollection of the content declined. We chose the light blue, which Tim adopted.
>His systems with embedded menus (or hot spots), where a significant user interface improvement over early systems such as Gopher. But Tim told me at the time that he was influenced by our design as he saw it in the Hypertext on Hypertext project that we used Hyperties to build for the July 1988 CACM that held the articles from the July 1987 Hypertext conference at the University of North Carolina. The ACM sold 4000 copies of our Hypertext on Hypertext disks.
Here's some more information about High-Precision Touchscreens, 1988-1991 HCIL Research, which may be what whoever mis-quoted Ben about inventing the iPhone keyboard was actually referring to. Specifically, Ben and his students developed the "Lift-Off Strategy" and other visual feedback techniques that made it possible to precisely select small targets on touch screens. Below, he simply and truthfully stated that "the iPhone uses a lift-off strategy", not that he invented the iPhone keyboard.
At the time, touchscreens were notorious for being hard to use, and they usually triggered on the location you initially touched the screen, instead of giving preview feedback when you touched, and letting you change the selection while providing visual feedback before lifting off and selecting something like a key or text or pixel.
Also, the precision touch screen work at HCIL was cited as prior art in legal cases contesting the Apple patents related to the "Slide to Unlock" touchscreen slider that unlocks the iPhone.
https://www.cs.umd.edu/hcil/touchscreens/ https://www.cs.umd.edu/hcil/touchscreens/
[...]
During 1989-1991, we worked on a home automation system and explored several direct manipulation designs (e.g. clocks and calendars to schedule devices to go on and off, ON-OFF switches with buttons or sliders) . A playful fingerpainting exploration tool and toy called Playpen was developed. Finally we worked with National Cash Register (NCR) to explore how touchscreens might be used to replace keyboards when store cashiers needed to enter a little bit of data about shopppers (such as phone numbers or addresses). We stopped doing research on touchscreens as successful applications found their ways in museums or cash registers. Pen interfaces, made popular by the Palm Pilots, continued the work as they afforded a similar sense of "real" direct manipulation. Eventually touchcreens came back as the input device of choice of mobile devices, especially after the launch of the iPhone is 2007.
For a quick summary of our work refer to:
Shneiderman, B. (March 1991), Touch screens now offer compelling uses,
IEEE Software 8, 2, (March 1991) 93-94, 107.
Also in Sparks of Innovation in Human-Computer Interaction, Shneiderman, B., Ed., Ablex (June 1993) 187-193.
http://www.cs.umd.edu/hcil/trs/91-02/91-02.pdf http://www.cs.umd.edu/hcil/trs/91-02/91-02.pdf
For a longer review of the state of the art of touchscreen use at that time see:
Sears, A., Plaisant, C., Shneiderman, B., A new era for high-precision touchscreens (1990 tech report),
CS-TR-2487, CAR-TR-506
Later published in Advances in Human-Computer Interaction, vol. 3, Hartson, R. & Hix, D. Eds., Ablex (1992) 1-33.
http://www.cs.umd.edu/hcil/trs/90-01/90-01.pdf http://www.cs.umd.edu/hcil/trs/90-01/90-01.pdf
We produced the first HCIL Video Report in 1991 by recording the demonstrations from 1988-1991 (most are now on YouTube and embedded below). Those videos were given along with copies of our papers to all the sponsors of the lab, and attendees of the annual HCIL symposium. The videos were available for sale, and have been used extensively in HCI classes. Many were also published as part of the ACM CHI videos.
http://www.cs.umd.edu/hcil/pubs/video91.shtml http://www.cs.umd.edu/hcil/pubs/video91.shtml
Between 1988 and 1993 Apple was a sponsor of the HCIL lab, Steve Jobs visited in person in 1988, and Ben Shneiderman was a consultant for Apple at several occasions. Demos were also shown to our lab's visitors, and videos shown during invited lectures at conferences or during industry visits (see Ben Shneiderman's resume for a partial list)
From bad reputation to high precision touchscreen
In 1987 (and still long afterwards) touchscreens had the bad reputation of being imprecise. Most user interface books would state that touchscreens selections were "of course limited to targets larger than the average finger". To use touchscreens for browsing information systems such as Hyperties, we had to be able to select small targets (e.g. the letters of the alphabets of the index table of content). At the time, all touchscreens selections were done in such a way that a target was selected as soon as the finger came over it, and the corresponding action was performed immediately (we called it "first touch" or "land-on" strategy). Errors were common, due to parallax or calibration problems, and users were frustrated when the wrong target was repeatedly selected by mistake.
Lift-Off strategy
A first breakthrough was to propose an alternative technique for selection: the lift-off strategy. As users touch the screen, feedback is provided as to what will be selected and the action takes place when the finger is lifted off the screen. In our implementation a cursor was drawn on the screen slightly above the finger. When the cursor was over a target, the target was highlighted. Users could then either lift-off their finger to select the highlighted target, or adjust their position by sliding their finger to a neighboring target. This was a major breakthrough: only the cursor position mattered for the selection, not the finger itself. Selecting a single character was now possible.
The touchscreen technology has greatly improved but overall the lift-off strategy is still useful (e.g. the iPhone uses a lift-off strategy.)
88-04 Potter, R.L., Weldon, L.J., Shneiderman, B. (May 1988).
Improving the accuracy of touch screens: an experimental evaluation of three strategies,
Proc. of the Conference on Human Factors in Computing Systems, CHI `88 (Washington, DC) 27-32.
Also Sparks of Innovation in Human-Computer Interaction, Shneiderman, B., Ed., Ablex (June 1993) 161-169.
High-Precision touchscreen: the next step was to try to stabilize the touchscreen so that the cursor would stay put when the finger didn't move. This was accomplished with a clever time-dependant averaging of the positions returned by the device. Now, individual pixels could be selected (in the 480x350 high resolution screen of the time). An experiment showed that there was significant difference in selection times and error rates between mouse and touchscreen for targets down to about 1mm2, when using a lift-off strategy with a stabilized touchcreen. Companies such as Elographics and Microtouch, with whom we had good relations, integrated stabilization techniques into the drivers of their touchscreens. From then on, high-precision was possible, and designers could do everything with the touchscreen that they could do with the mouse.
89-17 - Sears, A., Shneiderman, B. (June 1989)
High precision touchscreens: design strategies and comparisons with a mouse,
International Journal of Man-Machine Studies, (1991) 34, 4, 593-613.
Also Sparks of Innovation in Human-Computer Interaction, Shneiderman, B., Ed., Ablex (June 1993) 171-185.
[...]
Toggles (buttons, sliders, rockers etc.),
In 1990 we designed and compared a series of touchscreen toggle switches allowing devices to be switched ON or OFF. The designs included button type toggles and sliding toggles.
This video was distributed to the attendees of the 1991 Human-Computer Interaction Laboratory Open House on June 7, and later on published in the SIGGRAPH Video Review, Issue 77 corresponding to the CHI '92 Technical video program.(see the accompanying CHI'92 Proceeding short paper). The video and its short paper are now being cited as prior art in legal cases contesting the Apple patents related to the "Slide to Unlock" touchscreen slider that unlocks the iPhone.
http://dl.acm.org/citation.cfm?id=143079 http://dl.acm.org/citation.cfm?id=143079
http://www.cafc.uscourts.gov/sites/default/files/opinions-orders/15-1171.Opinion.2-24-2016.1.PDF http://www.cafc.uscourts.gov/sites/default/files/opinions-or...
Designed originally for home automation, those toggles were also later used in a NASA design toolkit. Now slider designs can be found everywhere in touchscreen-based smartphones (such as the first iPhone in 2007). As we mentionned in our paper and video a slider design is more secure so that the phone cannot be turned on by mistake. A click confirms the action. Any design that enforces a sliding gesture would achieve a similar goal.
90-08 Plaisant, C., Wallace, D. (Nov. 1990)
Touchscreen toggle switches: push or slide? Design issues and usability study,
CS-TR-2557, CAR-TR-521
http://www.cs.umd.edu/hcil/trs/90-08/90-08.pdf http://www.cs.umd.edu/hcil/trs/90-08/90-08.pdf
[...]
1991 Video Reports
http://www.cs.umd.edu/hcil/pubs/video91.shtml http://www.cs.umd.edu/hcil/pubs/video91.shtml
- DonHopkins 5y agoThere are some more links in the Internet History mailing list discussion started by Vint Cerf about the origin of the term "hyperlink", including some email from Ben Shneiderman and Marc Andreesen that they agreed to share: Top of discussion thread: https://elists.isoc.org/pipermail/internet-history/2020-April/thread.html#5939 https://elists.isoc.org/pipermail/internet-history/2020-Apri... First message: https://elists.isoc.org/pipermail/internet-history/2020-April/005939.html https://elists.isoc.org/pipermail/internet-history/2020-Apri... >From: vinton cerf >Date: Sun Apr 12 09:41:05 PDT 2020 >I asked Jeff Rulifson if he could help us figure out when "hyperlink" entered into usage. Jeff was the principal programmer for Douglas Engelbart's NLS editing system in which such links were introduced. Ted Nelson coined terms like "hypertext" in his Xanadu concept - the two were contemporary in the 1960s. >Here is Jeff's response: [...] Here's my reply quoting email from Ben Shneiderman and Marc Andreesen with more citations and links: https://elists.isoc.org/pipermail/internet-history/2020-April/005961.html https://elists.isoc.org/pipermail/internet-history/2020-Apri... >From: Ben Shneiderman >Date: 14 April 2020 at 22:38:16 CEST >I contacted Mark Anderson who provided some useful information – he agrees to passing this on, so you can share with others. See below and attachments. Claus Atzenbeck also works on hypertext history, but he could not provide further information. >So we don’t know who coined hyperlinks, but I think the claim that my idea (some time in 1984) and the work of UMd grad students (especially Ostroff and Koved) defined, implemented, and validated the visual design of highlighted selectable hyperlinks within a paragraph (what TBL called hot spots) remains intact. A strong piece of evidence is the April 1986 CACM paper with Koved. For those checking exact dates, the paper says “Received 9/85: accepted 11/85”. The Ewing et al paper from 1986 says “Received 6 March 1985” …both are attached. >Ewing J, Mehrabanzad S, Sheck S, Ostroff D and Shneiderman B (1986), "An experimental comparison of a mouse and arrow-jump keys for an interactive encyclopedia", International Journal of Man-Machine Studies, Jan., 1986, Vol 24, pp. 29-45. [Abstract <>] [BibTeX <>] [DOI <http://dx.doi.org/10.1016/S0020-7373(86)80038-4 http://dx.doi.org/10.1016/S0020-7373(86)80038-4>] >Ostroff D and Shneiderman B (1988), "Selection devices for users of an electronic encyclopedia: an empirical comparison of four possibilities", Information Processing and Management, Nov., 1988, Vol 24(6), pp. 665-680. [Abstract <>] [BibTeX <>] [DOI <http://dx.doi.org/10.1016/0306-4573(88)90004-0 http://dx.doi.org/10.1016/0306-4573(88)90004-0>] >The 4000 copies of the PC-based Hypertext on Hypertext disks, using Hyperties from Cognetics Corp, published by ACM appears to have been widely influential in gaining adoption. That is what TBL cites in his Spring 1989 manifesto for the web, and his choice of light blue highlighting comes from our work…. As he told me at some conference. >The video made around 2015 by me, shows it in operation: https://youtu.be/29b4O2xxeqg https://youtu.be/29b4O2xxeqg >Our web page is: http://www.cs.umd.edu/hcil/hyperties/ http://www.cs.umd.edu/hcil/hyperties/ >You are welcome to pass this around and/or post to the discussion boards that are debating this issue. Comments or clarifications are welcome. >--Ben >From: Mark Anderson >Sent: Tuesday, April 14, 2020 10:17 AM >Ben, >[cc-ing in Mark Bernstein who often seems to recall erly hypertext-related facts. Mark: this is discussion on first use of the term ‘hyperlink’, as well as use of coloured links. You might also add a useful reference on first use of the history (i.e. nodes traversed i-session) , booksmark and breadcrumbs ("Bookmark & Compass" perhaps?)] >Oh yes, please do. I do think early hypertext history likes this needs collecting, while we can. Straddling the start of the digitised print age, much of the early stuff is now on paper and hard to find. My bookshelf is now growing with publisher proceedings. They are bought second-hand and mostly come with (cancelled) university library. Thus for subjects that would have been niche at outset, the scope for loss if knowledge is high. >I have also know skim-read the ECHT’90 Proceedings (uot of print and no ebook available [sic]) and not found any mention of ‘hyperlinks’. > Anyway, here is the first mention, in context. The ABC paper (links as per my last email) in HYPERTEXT’91 Proceedings, page 185, original authors'styling of text: >Referring, once again, to level 1 of the data model: the server differentiates between structural links and hyperlinks. Constraints on structural links determine the type of the subgraph; –e.g., no node in a tree subgraph may have more than one incoming link. Hyperlinks, however, may join any two nodes in the same subgraph or in different subgraphs. … Thus, the first level of the data model actually consists of nodes, structural links, hyperlinks, subgraphs, and hypergraphs, all with associated contents and attributes. >I attach an RTF file with a number of hypertext-related proceeding (some only available in paper form). Both DL.ACM and IEEE proved incapable turning results for the term ‘hypertext’ in the full text of documents. In the case of DL.ACM it couldn’t even find the above which suggests OCR-recovered texts aren’t being indexed/searched properly. Oh dear! DL.ACM looking at the 1960-90 window did find 4 instance of the word hyperlink in 1991—none in hypertext papers. >The word is not indexed [sic] in my 1992 edition of O’Reilly’s “The Whole Internet” and I can’t find the term in the brief 36 pp chapter (#13) on the Web. I’ve also checked Nelson’s Literary Machines (I have a digitised copy of the c.1991 edition) as well of some of his early (late 60s) papers I’m helping archive at present. Nothing there. >Here is the file: [I have uploaded the PDF attachments and linked to them here (and inlined the text one), since the internet-history mailing list email size is limited. -Don] Embedded menus: Selecting Items in Context. Larry Koved and Ben Shneiderman. Communications of the ACM, Computing Practices, April 1986, Volume 29, Number 4, p. 312-318 https://donhopkins.com/home/documents/Koved-Embedded%20Menues-CACM-4-1986.pdf https://donhopkins.com/home/documents/Koved-Embedded%20Menue... An experimental comparison of a mouse and arrow-jump keys for an interactive encyclopedia John Ewing, Simin Mehrabanzad, Scott Sheck, Dan Ostroff and Ben Shneiderman International Journal of Man Machine Studies (1986) 24, p. 29-45 https://donhopkins.com/home/documents/Ewing-Ostroff-mouse-arrowkeys-IJMMS-1986-01-published.pdf https://donhopkins.com/home/documents/Ewing-Ostroff-mouse-ar... Origin-hyperlink: HYPERTEXT’87 Proceedings - nothing Hypertext I Proceedings (1988) - nothing (book source only) HYPERTEXT’89 Proceedings - nothing ECHT’90 Proceedings - nothing (book source only) Hypertext II Proceedings (1990) - nothing (book source only) HYPERTEXT’91 Proceedings (1 paper). Smith & Donaldson. ABC: a hypermedia system for artifact-based collaboration pp.179–192. https://dl.acm.org/doi/10.1145/122974.122992 https://dl.acm.org/doi/10.1145/122974.122992 p. 185: Referring, once again, to level 1 of the data model: the server differentiates between structural links and hyperlinks. Constraints on structural links determine the type of the subgraph; –e.g., no node in a tree subgraph may have more than one incoming link. Hyperlinks, however, may join any two nodes in the same subgraph or in different subgraphs. … Thus, the first level of the data model actually consists of nodes, structural links, hyperlinks, subgraphs, and hypergraphs, all with associated contents and attributes. ECHT’92 Proceedings - nothing HYPERTEXT’93 Proceedings - nothing ECHT’94 Proceedings (5 papers) Davis, Knight & Hall. Light hypermedia link services: a study of third party application integration pp.41–50 https://doi.org/10.1145/192757.192767 https://doi.org/10.1145/192757.192767 <https://doi.org/10.1145/192757.192767 https://doi.org/10.1145/192757.192767> 1 use of hyperlink Anderson, Tayloer & Whitehead. Chimera: hypertext for heterogeneous software environments pp.94–107. https://doi.org/10.1145/192757.192783 https://doi.org/10.1145/192757.192783 3 uses of hyperlink Christophides & Rizk. Querying structured documents with hypertext links using OODBMS pp.186–197. https://doi.org/10.1145/192757.192799 https://doi.org/10.1145/192757.192799 3 uses of hyperlink Ossenbruggen & Eliëns Music in Time-Based Hypermedia pp.224–227. https://doi.org/10.1145/192757.376055 https://doi.org/10.1145/192757.376055 1 use of hyperlink Brailsford Experience with the use of Acrobat in the CAJUN publishing project pp.228–232. https://doi.org/10.1145/192757.376057 https://doi.org/10.1145/192757.376057 3 uses of hyperlink HYPERTEXT’96 Proceedings (5 papers) HyperCafe: Narrative and Aesthetic Properties of Hypervideo pp1–10. https://doi.org/10.1145/234828.234829 https://doi.org/10.1145/234828.234829 p.7 Fig. 8 Caption: A portion of the HyperCafe script organized and hyperlinked using Storyspace Moulthrop, Stuart. Dreamtime, A hypertext with time-constrained hyperlinks,1992. Ut pictura hyperpoesis: spatial form, visuality, and the digital word pp.66–73. https://doi.org/10.1145/234828.234835 https://doi.org/10.1145/234828.234835 3 uses of hyperlink Evaluating HyTime: an examination and implementation experience pp.105–115 https://doi.org/10.1145/234828.234839 https://doi.org/10.1145/234828.234839 <https://doi.org/10.1145/234828.234839 https://doi.org/10.1145/234828.234839> 12 uses of hyperlink HyPursuit: a hierarchical network search engine that exploits content-link hypertext clustering pp.180–193 https://doi.org/10.1145/234828.234846 https://doi.org/10.1145/234828.234846 <https://doi.org/10.1145/234828.234846 https://doi.org/10.1145/234828.234846> 23 uses of hyperlink Logic programming with the World-Wide Web pp.235–245. https://doi.org/10.1145/234828.234851 https://doi.org/10.1145/234828.234851 <https://doi.org/10.1145/234828.234851 https://doi.org/10.1145/234828.234851> 18 uses of hyperlink