projet de recherche en réalité augmentée par Disney Research

Karl D.D. Willis, Takaaki Shiratori, Moshe Mahler

Informations

• Publié par: ActuaLitte.com
• Publié le: 18 juillet 2013
• Nombre de lectures: 241
• Langue: English
• Poids de l'ouvrage: 1 Mo

Extrait

HideOut: MobileProjectorInteraction
withTangibleObjectsandSurfaces
1,3 2 1KarlD.D.Willis TakaakiShiratori MosheMahler
1 2 3DisneyResearchPittsburgh MicrosoftResearchAsia ComputationalDesignLab
Pittsburgh,PA,USA Beijing,China CarnegieMellonUniversity
{karl,moshe.mahler}@disneyresearch.com [e-mail] Pittsburgh,PA,USA
b e
a c d f
Figure 1. HideOut is a mobile projector-based system that uses hidden markers (c,f) to map projected imagery onto
tangibleobjectsandsurfaces(b,e)suchasstorybooks(a)andboardgames(d).
ABSTRACT onthego,andplaygamesanywhere. Mobileprojectorsarea
recent technology that enables these interactions, and manyHideOutisamobileprojector-basedsystemthatenablesnew
others, to be situated in the immediate environment ratherapplicationsandinteractiontechniqueswithtangibleobjects
and surfaces. HideOut uses a device mounted camera to than confined to a mobile device. Interaction in the physi-
detect hidden markers applied with infrared-absorbing ink. calenvironmentbuildsuponour‘pre-existingknowledgeof
Theobtrusiveappearanceoffiducialmarkersisavoidedand the everyday, non-digital world’ [13] and opens up a rich
thehiddenmarkersurfacedoublesasafunctionalprojection space for mobile devices that support tangible interaction.
surface. We present example applications that demonstrate Wearemotivatedbythevisionofmobileprojectorsthatare
awiderangeofinteractionscenarios,includingmedianavi- responsive to tangible objects and surfaces in the immedi-
gationtools,interactivestorytellingapplications,andmobile ate environment — identifying each object, tracking its po-
games. WeexplorethedesignspaceenabledbytheHideOut sition,andprojectingappropriatecontentbackintotheenvi-
systemanddescribethehiddenmarkerprototypingprocess. ronment. Objectsandsurfacessuchasbooks,posters,table-
HideOut brings tangible objects to life for interaction with tops, walls, and board games can all be brought to life with
thephysicalworldaroundus. projected imagery. With as many as 39 million embedded
projectors predicted to be on the market by 2014 [19], we
AuthorKeywords believenowisanidealtimetoexplorethisrichnewspace.
Mobile, projector, interaction, tangible, infrared, ink, hid-
To realize our vision we have developed HideOut, a proto-
den,marker
type system that can map projected imagery onto tangible
objectsandsurfacesintheenvironmenttoempowernewap-ACMClassificationKeywords
plicationsandinteractiontechniques(Figure1). ThesystemH5.2[Informationinterfacesandpresentation]: Miscellaneous
consists of a custom mobile projector device with an on-
INTRODUCTION board camera to track hidden markers applied with infrared
Mobile devices have become an important part of our day- (IR) absorbing ink, as first described by [25]. The obtru-
to-dayinteractionwithcomputingsystems. Theyallowusto sive appearance of fiducial markers is avoided and the hid-
communicate information at any time, view digital content den marker surface doubles as a functional projection sur-
face. The resulting system serves as a platform to explore
newmobileandtangibleinteractiontechniquesthatmapin-
Permission to make digital or hard copies of all or part of this work for
teractive imagery onto tangible objects and surfaces. Dig-
personal or classroom use is granted without fee provided that copies are
ital media files can be browsed with a large projected im-not made or distributed for profit or commercial advantage and that copies
bearthisnoticeandthefullcitationonthefirstpage. Tocopyotherwise,or age using available table or wall space. Immersive games
republish,topostonserversortoredistributetolists,requirespriorspecific canbedevelopedthatallowinteractionwithphysicalobjects
permissionand/orafee. and surfaces within the environment. Story books can be
TEI2013,February10–13,2013,Barcelona,Spain.
Copyright2013ACM978-1-4503-1898-3/13/02....$15.00.brought to life with interactive content in a lightweight and anotherapproachforconcealingmarkerpatternswhenapo-
exploratoryway. Thesystemdoesnotrequireactivesensing larizedback-lightisreadilyavailable,suchasanLCDscreen
infrastructure,meaninginteractioncantakeplacewithmin- [10, 15]. However, without polarized back-lighting, a gray-
imalpreparationoftheenvironment. Interactiveobjectsand colored polarizing filter must be applied — degrading the
surfaces can quickly be prototyped for reliable tracking and transparenteffect.
identification. Wepresentthefollowingcontributions: Finally, IR-absorbing ink has long been used in the secu-
1. Adetailedexplorationoftheapplicationspaceformobile rityindustryfordocumentauthentication. IR-absorbinginks
projector interaction with objects and surfaces in the im- have been utilized for interaction to embed hidden informa-
mediateenvironment,includingexampleapplicationsthat tioninknittedartifacts[33],tohidefiducialmarkersforuse
demonstratetherangeofinteractionscenariospossible. withaugmentedrealityvideosee-throughdisplays[25],and
to support tracking and registration of imagery from fixed2. Afunctionalprototypesystemconsistingofcustomhard-
projectorsystems[23]. IR-absorbinginkisparticularlyuse-wareandsoftware,anddiscussionofthedesignandratio-
fulbecauseitcanbeappliedtoarangeofmaterialswithoutnalebehindthesystem.
changing the surface texture or finish. Commonly available
3. Documentationoftheperformance,practicalities,andim- papersfunctionasprojectionsurfacesandcaneasilybeem-
plementationdetailsforcreatinghiddenmarkerprojection bedded with hidden patterns. Based on these properties, we
surfacesusingIR-absorbingink. buildupontheuseofhiddenfiducialmarkers[25,23]toex-
plore novel interaction techniques and applications enabled
RELATEDWORK
bythenewaffordancesofmobileprojectors.
Research related to the HideOut system spans the areas of
projector-based augmented environments, mobile projector HIDEOUT
interaction,andhiddenmarkertracking. We now describe the key components of the HideOut sys-
tem: hidden marker projection surfaces, our custom hard-Augmentation of the environment with projected imagery
waredevice,andoursoftwaresystem.has been the long-term goal of ‘spatial augmented real-
ity’ [3]. Notable approaches to image tracking and reg-
HiddenMarkerProjectionSurfaces
istration include commercial motion-capture systems [2],
Hiddenmarkerprojectionsurfacesutilizeasinglesurfaceforphoto-sensors with structured light patterns [16], steerable
both tracking input and projector output (Figure 2). Thesecamera-projector pairs [28], fiducial marker tracking [32],
two information streams are kept separate by embeddingand depth-camera-based systems [39]. These projects high-
markerpatternsthatarehiddentothehumaneyebutcanbelight the potential to enhance the user experience by aug-
viewed with a camera in an invisible spectrum, such as IR.mentingenvironmentswithprojectedimagery. Anumberof
The output image is projected onto the same surface and isportable systems have also been developed that do not re-
visibletothehumaneyebutinvisibletothecamera. Bothin-
quire instrumentation of the environment [14, 38]. These
formation streams operate independently without crosstalk.
systems, however, are designed for use in a stationary posi-
This approach provides both a plain projection surface for
tion—weaimtoenablemobileinteractionthatcanaugment
unimpeded viewing of the projected imagery and a textured
objectsandsurfacesinanyspace.
surface for simplified tracking. Arbitrary information can
Prototype systems exploring the use of mobile projectors also be encoded into the surface markings such as location
haveusedactivesensinginstalledintheenvironmenttoiden- data,objectidentificationcodes,orwebsiteinformation.
tifyandinteractwithtaggedobjects[30]andnavigatevirtual
We use IR-absorbing inks to create marker patterns that are
workspaces [4, 5]. Camera-based systems allow mobile in-
hidden to the human eye (Figure 3a), but visible to an IR-
teractionwithsurfacesintheenvironment[20,40]andwith
sensitive camera (Figure 3b). This approach avoids the ob-
other users [6, 24, 36]. Depth-camera-based systems [7, 9,
trusive appearance of visible fiducial markers and frees up
12, 21] can sense detailed information about the geometry
valuable space to function as a projection surface. We care-of the surrounding environment. Our approach using hid-
fully select IR-absorbing inks that are suitable for use withdenmarkerscancomplimenttheuseofdepth-cameraswhen
lightweightobjectidentificationisrequired,orwhenthereis Camera Input Image
alackofvisible/depthfeaturesinthescene,e.g. withalarge
flatwhitewall. Hidden Marker
The obtrusive nature of fiducial markers has motivated a
number of approaches for concealing markers from the hu-
maneye. Thesecanbedividedroughlyintofourcategories.
Retroreflective materials have been reliably used with sev- Projector Output Image
eral systems [11, 17, 22, 35], butare difficult to conceal en-
tirelyandcanreflectvisiblelightbacktotheuserwhenused
with handheld projection. Scaling the marker pattern down,
Mobile Cameraso it is nearly imperceptible to the user, is another approach
& Projector Device
usedbytheAnotoDigitalPensystem(www.anoto.com). Al-
though the marker pattern performs well as a projec-
tionsurface[34],trackingislimitedtowithincloseproxim- Figure2. Camerainputandprojectoroutputarefocused
onthesamehiddenmarkerprojectionsurface.ity to the marker pattern. Transparent polarizing films areb
a b
Figure 3. Hidden markers created with IR absorbing