edith@ai.toronto.edu (Edith Fraser) (02/23/90)
Department of Computer Science, University of Toronto (SF = Sandford Fleming Building, 10 King's College Road) ------------------------------------------------------------- COLLOQUIUM SF1105, at 11:00 a.m., 6 March 1990 Hamed Ellozy Thomas J. Watson Research Center Edith Fraser The Paper-Like Interface This talk will describe a promising advance in the area of user interfaces, namely: the domain of interfaces to highly interactive, visually oriented applications whose primary function is to support editing or incremental change. We are developing the necessary technology to permit users to interact with applications in much the same style that they would employ in a paper and pencil interface. Such applications are ubiquitous, ranging from simple editing, to making spreadsheet "what-if" projections, to database explortion. They cover text, graphics, and image-oriented applications. Our technology allows the user to "write" directly on a display, using a special scribing device. For example, a user could "markup" a document using editing symbols, or enter textual information, or manipulate a spreadsheet, or manipulate graphical information, etc. As part of our efforts to evaluate the useability of such interfaces, we have developed a "front-end" for Lotus 1-2-3 whereby a user can directly markup and modify the spreadsheet with handwriting and editorial marks. Representative front-ends to potential "real" applications will also be described. One such application is a music sheet editor, whereby a user can write both lyrics and notes on the display, perform editing operations, and "play" the notes. Another prototype application is a sketch pad that combines gesture recognition and handwriting recognition. Yet another application is a mathematical formula formatter that recognizes gestures, such as integral, summation, and special symbols. A videotape detailing some of the features of the Paperlike Interface will be shown.