Spatial modeling of activity and user assistance in instrumented environments [Elektronische Ressource] / vorgelegt von Christoph Stahl

Windows-Benutzer

Sujets

• Informatik

Informations

• Publié par: universitat_des_saarlandes
• Publié le: 01 janvier 2009
• Nombre de lectures: 23
• Langue: Deutsch
• Poids de l'ouvrage: 7 Mo

Extrait

Spatial Modeling of Activity and User
Assistance in Instrumented
Environments

Dissertation
zur Erlangung des Grades des
Doktors der Ingenieurswissenschaften (Dr.-Ing.)
der Naturwissenschaftlich-Technischen Fakultäten der
Universität des Saarlandes

vorgelegt von
Dipl.-Inform. Christoph Stahl

Saarbrücken,
den 5. November 2009























Dekan:
Prof. Dr. Joachim Weickert
Vorsitzender des Prüfungsausschusses:
Prof. Dr. Philipp Slusallek
Berichterstatter:
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster
Prof. Dr. Bernd Krieg-Brückner
Prof. Dr. Antonio Krüger
Akademischer Beisitzer:
Dr.-Ing. Jörg Baus
Tag des Kolloquiums:
2. Dezember 2009

ii
Eidesstattliche Versicherung
Hiermit versichere ich an Eides statt, dass ich die vorliegende Arbeit selbstständig und ohne
Benutzung anderer als der angegebenen Hilfsmittel angefertigt habe. Die aus anderen
Quellen oder indirekt übernommenen Daten und Konzepte sind unter Angabe der Quelle
gekennzeichnet.
Die Arbeit wurde bisher weder im In- noch im Ausland in gleicher oder ähnlicher Form in
einem Verfahren zur Erlangung eines akademischen Grades vorgelegt.




___________________________
Saarbrücken, 5. November 2009

iii
Short Abstract
This dissertation presents a design method for proactive user assistance systems in
instrumented environments. The method addresses typical design issues, such as the
modeling of users’ needs and the choice and placement of sensors and actuators for human-
environment interaction. The design process is supported through the combination of a
geometric environment model and a situational semantic activity model. The geometric
model is used to visualize the spatial context, in which the activities that are to be supported
take place. The activity model is derived from Activity Theory and hierarchically represents
tasks and activities in their situational context. Both models are linked by an ontology and
form a hybrid location model. To support the method, we implemented a map modeling
toolkit that allows to geometrically represent built environments in 3-D, and to model their
furnishing and instrumentation with sensors and actuators. Of particular importance was the
development and integration of an ontology-based activity editor. Furthermore, the toolkit
facilitates the development of navigational aid through a route finding algorithm. The work
concludes with five use cases that describe how the method and modeling toolkit have been
applied for the design and development of intelligent environments and navigational aid for
indoor and outdoor spaces. It also highlights how Dual Reality settings have contributed to
the simulation of the developed assistance systems.
iv
Kurzzusammenfassung
Diese Doktorarbeit legt eine Designmethode für proaktive Benutzerassistenzsysteme in
instrumentierten Umgebungen vor. Die Methode richtet sich an typische Designprobleme,
wie das Modellieren der Bedürfnisse der Benutzer sowie Auswahl und Platzierung von
Sensoren und Aktuatoren zur Interaktion mit der Umgebung. Der Designprozess wird durch
ein geometrisches Umgebungsmodell und ein situiertes, semantisches Aktivitätsmodell
unterstützt. Das geometrische Modell wird verwendet, um den räumlichen Zusammenhang
zu veranschaulichen, in dem die zu unterstützenden Tätigkeiten stattfinden. Das Aktivitäts-
modell wird aus der Aktivitätstheorie abgeleitet und repräsentiert Tätigkeiten in ihrem situ-
ativen Kontext. Beide Modelle werden durch eine Ontologie verbunden und bilden ein
hybrides Ortsmodell. Zur Unterstützung der Methode haben wir ein Modellierungswerkzeug
implementiert, das es ermöglicht, Gebäudeumgebungen dreidimensional zu repräsentieren,
und deren Einrichtung und Instrumentierung mit Sensoren und Aktoren zu modellieren.
Besonders wichtig war die Entwicklung und Integration eines ontologiebasierten Akti-
vitätseditors. Weiterhin erleichtert das Werkzeug die Entwicklung von Navigationsassis-
tenten durch einen Wegsuchealgorithmus. Die Arbeit schließt mit fünf Anwendungsbei-
spielen, in denen die Methode und das Modellierungswerkzeug für das Design und die Ent-
wicklung von intelligenten Umgebungen und Navigationshilfen angewandt worden ist. Es
wird auch gezeigt, wie Dual Reality Umgebungen zur Simulation der Assistenzsysteme
beigetragen haben.

v
Acknowledgements
I want to thank the DFG (Deutsche Forschungsgesellschaft) for funding my position in the
Collaborative Research Center 378 “Resource-Adaptive Processes”, and especially the
Transfer Unit 53 “Resource-Adaptive Navigation”, which made this research possible.
Most of all, I want to thank Prof. Wahlster for providing the chance to work on my PhD at his
AI chair, and for finding the time for intense supervision and inspiring discussions during the
final stages of this work. Likewise, Prof. Bernd Krieg-Brückner contributed to this work by
insightful discussions on AAL-related topics.
This work is rooted in our AI group’s collaborative effort to instrument the lab with
ubiquitous computing technology and the experience of being involved in the development
of various user assistance systems. I want to thank Antonio Krüger for his foresight to
transform the lab into an instrumented environment, and all my colleagues from the chair of
Prof. Wahlster for their commitment to SUPIE: Especially Jörg Baus for being a helpful and
humorous office mate for so many years; Tim Schwartz for the joint work on indoor
positioning; Dominik Heckmann for constant moral support and his UbisWorld; Rainer
Wasinger for the fruitful collaboration on m3i; Michael Schmitz for developing the
presentation manager; Mira Spassova for the steerable projector; Gerrit Kahl for delicious
desserts; Boris Brandherm for his geoDBNs and bearing me company in the lab at oddest
times; and finally our admins and Doris for taking care. At DFKI, Michael Schneider and
Alexander Kröner have been involved in the SmartKitchen. In Bremen, I have to thank Tim
Laue for his support with SimRobot.
I am especially thankful to Ichiro Kobayashi for for the successful collaboration towards
activity modeling during his stay at the AI lab. It has also been a pleasure to work with Stefan
Münzer, who contributed the wayfinding user study.
Last but not least I want to thank all the students who worked hard to implement and realize
my ideas. First of all, credits go to Jens Haupert, who continuously implemented
YAMAMOTO during 2003-2007. Without his patience and dedication, this toolkit would not
exist. Likewise, my thanks go to Sebastian Wassmuth, who contributed the PathFinder
algorithm. Acknowledgments also to Pascal Recktenwald for the Activity Editor component,
Oliver Fickert for his extensive engagement towards the task planner, and Felix Schöttle for
realizing the visual navigational aid. I also have to thank Michael Schmidt, Ingo Ruth, Philipp
Brendel, and Andreas Maier for their contributions to the spatial audio guide.
Thanks also to Alexander and Yasemin for being best friends in all the good and bad times.
Most importantly, thank you Dimitra, for your love, appreciation, and constant support of
my work. Σ'αγαπώ πολύ!
Christoph Stahl in November 2009
vi
Table of Contents
1 Introduction ............................................................................................................... 1
1.1 Introduction ................. 1
1.2 User Assistance in Instrumented Environments ......................... 3
1.3 Lessons Learned on the Design of Intelligent Environments ...................................... 4
1.4 Subject and Goal of this Thesis .................................................... 5
1.5 Thesis Outline .............................................. 8
2 Background & Basic Concepts ..................................................... 9
2.1 Interaction Design........................................ 9
2.1.1 Conceptual Models Based on Activities ............................... 9
2.1.2 Conceptual Models Based on Objects and Metaphors ...... 12
2.1.2.1 Desktop ....................................................................................................... 12
2.1.2.2 Virtual Environments .................. 12
2.1.2.3 Anthropomorphic Interfaces ...... 12
2.1.2.4 Augmented Artifacts ................................................................................... 13
2.1.2.5 Discussion .................................... 13
2.1.3 Interaction Paradigms ........................ 14
2.1.3.1 Desktop Computing .................................................................................... 16
2.1.3.2 Virtual Reality .............................. 16
2.1.3.3 Mixed Reality 16
2.1.3.4 Ubiquitous Computing ................................................................................ 19
2.1.3.5 Discussion .................................... 22
2.1.4