ICCGI-08 Tutorial animated

Kaindl

Description

„„„„„„Human-Computer Interaction based on Discourse ModelingHuman-Computer Interaction based on Discourse ModelingHermann KaindlInstitut fürComputertechnik Vienna University of Technology, ICTICTAustriaInstitute ofComputer Technology [e-mail] theories underpinning discourse modeling for HCIOther theories underpinning discourse modeling for HCIInteraction design based on discourse modelingExerciseSketch of automated user-interface generationInstitute of Computer Technology© Hermann Kaindl 1„„„„„„„„„Human-Computer Interaction based on Discourse ModelingTraditional UI developmentBased on toolkits employing widgetsWidgets grouped according to their graphical appearanceHighly-specialized designers and programmers neededLots of UI codeError-prone, low maintainabilityExpensiveInstitute of Computer TechnologyWidgetsInteractive objects presented on the display● windows ● buttons ● scroll barsUser interface elementsClassification hierarchy of widgetsWidgetWidget for Selecting an Action Control Tool Container WidgetInstitute of Computer Technology© Hermann Kaindl 2„„„„„„„Human-Computer Interaction based on Discourse ModelingInteraction designDesign of interactions between human and computerRelation to requirements engineeringtask analysisNo commitment to specific user interfaceInstitute of Computer TechnologyScenarios – Stories and narrativesFor representation of● cultural ...

Informations

• Publié par: Nizur
• Nombre de lectures: 30
• Langue: English

Extrait

Human-Computer nIetartcoi nabesond is Durco Mseledo © gni mreH nnadl1Kain

Institute of Computer Technology

Outline „ Background „ AI theories underpinning discourse modeling for HCI „ Other theories underpinning discourse modeling for HCI „ Interaction design based on discourse modeling „ Exercise „ Sketch of automated user-interface generation

Hermann Kaindl Vienna University of Technology, ICT Austria [e-mail]

Institut für Computertechnik ICT Institute of Computer Technology

Human-Computer Interaction based on Discourse Modeling

Widgets „ Interactive objects presented on the display ●windows ●buttons ●scroll bars „ User interface elements „ Classification hierarchy of widgets Widget

Institute of Computer Technology

Widget for Selecting an Action Control Tool Container Widget Institute of Computer Technology

Traditional UI development „ Based on toolkits employingwidgets „ Widgets grouped according to their graphical appearance „ Highly-specialized designers and programmers needed „ Lots of UI code „ Error-prone, low maintainability „ Expensive

uH-nampmoC reH© gniledoM esr l2ndai Knnma itnorecaI tnturescoun Died o bas

edoM esruocsiD n oedas bontiacer dn3l Kaimann©Her lingtureI tnam-noCpmHu

Institute of Computer Technology

Institute of Computer Technology

Interaction design „ Design of interactions between human and computer „ Relation torequirements engineering „ Relation totask analysis „ No commitment to specificuser interface

Scenarios  Stories and narratives „ Forrepresentationof ●cultural heritage ●explanations of events ●everyday knowledge „ Humanunderstandingin terms of specific situations „ Humanverbal interactionsby exchanging stories

„ Schank and Abelson „ Script: structure that describes appropriate sequences of events in a particular context „ Handles well-known everyday situations „ Predetermined and stereotyped sequence of actions

Institute of Computer Technology

Scripts

Institute of Computer Technology

Outline

„ Background „ AI theories underpinning discourse modeling for HCI „ Other theories underpinning discourse modeling for HCI „ Interaction design based on discourse modeling „ Exercise „ Sketch of automated user-interface generation

indl4 leni © g eHmrna naK  Doncoisseurod Maretoitcab n des-Comumanr InputeH

nigsiD ruocM esledoctran iosebaond naC-moupet rnIetHum

Institute of Computer Technology

Scripts  Restaurant script example Sketch of stereotypical sequence of actions in (U.S.) restaurant: A customer enters a restaurant and waits to be seated. A waiter guides the customer to an empty table and hands over a menu. The customer studies the food list in the menu and chooses something. The waiter comes to the table and takes the order. 

Rhetorical Structure Theory (RST) „ Mann and Thompson „ Linguistic theory „ Internal relationships among text portions and associated constraints and effects „ Relationships in a text are organized in a tree structure „ Rhetorical relationsassociated with non-leaf nodes, and text portions with leaf nodes

Institute of Computer Technology

5

© Hermann Kaindl

Human-Computer Interaction based on Discourse Modeling

© Hermann Kaindl

Institute of Computer Technology

RST Taxonomy (selection)

Ontologies

„ Tom Gruber „ Actually, the old Greeks „ Domain models „ Conceptualizations of a domain „ Often using taxonomies and object-based ideas „ Ontology languagesbased on knowledge- representation theories „ E.g., OWL based on description logic

Institute of Computer Technology

6

Model of domain of discourse for online shop example

Institute of Computer Technology

Institute of Computer Technology

Ontologies

„ Background „ AI theories underpinning discourse modeling for HCI „ Other theories underpinning discourse modeling for HCI „ Interaction design based on discourse modeling „ Exercise „ Sketch of automated user-interface generation

Outline

 eoMedilgn H©reamnn Kaindl7 I reretnitcab noedasn  oscDirsouHumamputn-Co

Human-Computer Interaction based on Discourse Modeling

© Hermann Kaindl

Speech acts

„ John R. Searle „ Theory from philosophy of language „ Human speech also used to do something with intention  to act „ Speaking a language is performing speech acts, act such as making statements, giving commands, asking questions and so on „ Speech acts: basic units of language communication „ Communicative acts: abstraction from speech

Institute of Computer Technology

Communicative Acts Taxonomy (selection)

8

eHmr ni © gdoleesM  dl9Kainann  tcar noi retetnIis Durcosebaond an-CompuHum

Conversation Analysis „ Harvey Sacks; Luff, Gilbert and Frohlich „ Theory from sociology „ Focus on sequences of naturally-occurring talk turns „ To detect patterns that are specific to human oral communication „ Adjacency pair: e.g., a question should have a related answer „ Inserted sequence: subordinate interactions

Institute of Computer Technology

Outline

„ Background „ AI theories underpinning discourse modeling for HCI „ Other theories underpinning discourse modeling for HCI „ Interaction design based on discourse modeling „ Exercise „ Sketch of automated user-interface generation

Institute of Computer Technology

© Hermann Kaindl

Discourse atoms and molecules „ Metaphorical view „ Communicative acts as atoms „ Adjacency pairs as molecules „ Communicative acts instead of RST text portions „ Interaction instead of text „ Two dimensions ●Tree with discourse relations (monologue) ●Adjacency pair (dialogue) „ Integration of RST and procedural constructs with Conversation Analysis

10

Discourse Example

Institute of Computer Technology

Institute of Computer Technology

Discourse Model

scDirsouedasn  oitcab noI reretngn eoMedilmputn-CoHuma

Human-Computer Interaction based on Discourse Modeling

© Hermann Kaindl

Communicative Acts  Open & Closed Question „ Open Questions enable asking for a particular type of information, respectively, an instance of a domain class. „ Closed Questions restrict the possible answer to a list of provided domain instances to choose from.

Institute of Computer Technology

Communicative Acts  Informing & Answer „ Both are used to convey information. „ Answer communicative acts are always directly related to questions, whereas Informing is uttered standalone or together with acknowledgment.

Institute of Computer Technology

11