Embed Size (px)
Citation preview
State-of-the-art reportin Augmented Reality
authoring/modelling/presenting
Eng. Pedro Santos [email protected]
Miguel [email protected]
ADETTI/ISCTE Jan 2005This work is part of an Msc thesis in
Computer and Telecom. Engineering - Multimedia
... ART02 / ISMAR02 / ART03 / ISMAR03 / ISMAR04 ...... ART02 / ISMAR02 / ART03 / ISMAR03 / ISMAR04 ...
ART02ART02
AR-based Product Design in Automobile Industry
This paper describes different scenarios for the use of augmented reality in the early design phase for new cars. The prototype uses different tracking systems like AR-ToolKit, Polhemus Fastrack and Pinch Gloves for user interaction.
Dipl.-Inform. Juergen FruendDipl.-Inform. Carsten Matysczok
Cand. Ing. Rafael RadkowskiHeinz Nixdorf Institute, University of PaderbornFuerstenallee 11, Paderborn, 33102, Germany
{fruend, onestone, rafael}@hni.uni-paderborn.de
ISMAR02ISMAR02
Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design
Spacedesign is an innovative Mixed Reality (MR) application addressed to aesthetic design of free form curves and surfaces. It is a unique and comprehensive approach which uses task-specific configurations to support the design workflow from concept to mock-up evaluation and review. The first-phase conceptual design benefits from a workbench-like 3-D display for free hand sketching, surfacing and engineering visualization. Semitransparent stereo glasses augment the pre-production physical prototype by additional shapes, textures and annotations. Both workspaces share a common interface and allow collaboration and cooperation between different experts, who can configure the system for the specific task. A faster design workflow and CAD data consistency can be thus naturally achieved.
Michele FiorentinoDIMeG, Politecnico di Bari, Italy
Raffaele de AmicisGRIS ,Universität Darmstadt, Germany
Giuseppe Monnod.Dis, Politecnico di Bari, Italy
Andre StorkIGD A2, Darmstadt, Germany
Augmented Urban Planning Workbench: Overlaying Drawings, Physical Models and Digital Simulation
There is a problem in the spatial and temporal separation between the varying forms of representation used in urban design. Sketches, physical models, and more recently computational simulation, while each serving a useful purpose, tend to be incompatible forms of representation. The contemporary designer is required assimilate these divergent media into a single mental construct and in so doing is distracted from the central process of design. We propose an Augmented Reality Workbench called “Luminous Table” that attempts to address this issue by integrating multiple forms of physical and digital representations. 2D drawings, 3D physical models, and digital simulation are overlaid into a single information space in order to support the urban design process.
Hiroshi Ishii, John UnderkofflerDan Chak, Ben Piper
Tangible Media Group, MIT Media Laboratory{ishii, jh, chak, benpiper}@media.mit.edu
Eran Ben-Joseph, Luke Yeung*, Zahra KanjiDepartment of Urban Studies and Planning
Department of Architecture*MIT School of Architecture and Planning
{ebj, lyeung, zahra}@MIT.EDU
Alternative Tools for Tangible Interaction: A Usability Evaluation
In this work we compare an in-house designed Tangible User Interface (TUI) with three alternative single-user tools through an empirical investigation. These three alternative tools are a 3D physical, a 2D cardboard, and a mathematical tool. We expected the 3D physical to perform best, followed by the TUI, the 2D cardboard, and the mathematical tool. A pilot study was first carried out, the results of which were used to design a major experiment. Participants solved the same positioning problem, each using one of the four tools. The mathematical tool was not used in the experiment. In the experiment, trial time, number of user operations, learning effect in both preceding variables, and user satisfaction were measured.
Morten Fjeld, Sissel Guttormsen Schär,Domenico Signorello, Helmut Krueger
IHA, Swiss Federal Institute of TechnologyClausiusstr. 25, CH-8092 Zurich, Switzerland
[email protected], [email protected],[email protected], [email protected]
A pragmatic approach to Augmented Reality Authoring
In this paper we describe the Augmented Reality (AR) authoring system "PowerSpace" which allows fast and comfortable generation of AR worlds. The system presented uses the functionality of a 2D presentation program (Microsoft PowerPoint) as the basis for the composition of 3D content. An MS PowerPoint export is used to generate an XML-based extensible description of a presentation. This description is enriched by 3D content with the help of an editor, which is also part of the PowerSpace system. The content of this presentation is finally converted into 3D scenes and is used in an AR-Viewer.
Matthias HaringerFachhochschule Ulm
University of Applied SciencesP.O. Box 3860, 89028 Ulm / Germany
+49 731 [email protected]
Holger T. RegenbrechtDaimlerChrysler AG, Research and Technology
Virtual and Augmented EnvironmentsP.O. Box 2360, 89013 Ulm / Germany
+49 731 505 [email protected]
MR Platform: A Basic Body on Which Mixed Reality Applications Are Built
This paper describes a platform package, called “MR Platform,” which we have been implementing for research and development of augmented reality technology and applications. This package includes a parallax-less stereo video see-through HMD and a software development kit (SDK) for a Linux PC environment. The SDK is composed of a C++ class library for making runtime MR applications and related utilities such as a camera calibration tool. By using the SDK, the following functions are available; capturing video, handling a six degree-offreedom (DOF) sensor, image processing such as color detection, estimating head position and orientation, displaying the real world image, and calibrating sensor placement and camera parameters of two cameras mounted on the HMD.
Shinji Uchiyama, Kazuki Takemoto, Kiyohide Satoh,Hiroyuki Yamamoto, and Hideyuki Tamura
MR Systems Laboratory, Canon Inc.2-2-1 Nakane, Meguro-ku, Tokyo, 152-0031 Japan
{uchiyama.shinji,takemoto.kazuki,sato.kiyohide,yamamoto.hiroyuki125}@canon.co.jp,[email protected]
Inexpensive Non-Sensor Based Augmented Reality Modeling of Curves and Surfaces in Physical Space
Previous works in modeling of curves and surfaces in augmented reality (AR) space has used expensive sensors such as magnetic sensors. In this work, we propose an augmented reality system where a user can model interesting surfaces with her hands, and without expensive sensing systems. The system uses computer vision based methods for the tracking of the user’s head and hand position. Using a glove and the tracking system, the user can draw smooth lines or surfaces with her hands in a physical space. Also the user can intuitively modify the lines or surface created by pushing or pulling at the control points of the lines or curve in a tangible manner.
Adrian David Cheok, Neo Weng Chuen Edmundand Ang Wee Eng
National University of Singapore,http://mixedreality.nus.edu.sg
ART03ART03
3D-Registered Interaction-Surfaces in Augmented Reality Space
This paper describes the ARGUI system, which provides developers of ARToolkit applications with the possibility to create 2D Interaction-Surfaces registered in 3D. With ARGUI 2D interactions on 2D objects registered in 3D are possible, e.g. attached to a marker. The integration of a complete 2D GUI library is shown in detail, which simplifies the creation of the user interface even more.
Christian Geiger#, Leif Oppermann#, Christian Reimann*,#Hochschule Harz, *Paderborn University C-LAB
A Dice Game in Third-Person Augmented Reality
We describe a prototype entertainment application of the Augmented-Reality Toolkit based on a fantasy dice game. Two players roll dice bearing glyphs that are interpreted by a computer, which provides graphical and auditory feedback. Our prototype uses entirely consumergrade equipment: A USB webcam, a projector, and a 2 GHz desktop with 5.1 surround speakers. Unlike many AR-Toolkit applications, our players are not encumbered by head-mounted displays. Face-to-face gameplay, integrated with the physicality of a traditional dice game, display results on a shared projection screen from a third-person point-of-view.
Richard Colvin, Ted Hung, David Jimison,Benjamin Johnson, Eben Myers, Tina Blaine
Entertainment Technology CenterCarnegie Mellon University
700 Technology DrivePittsburgh, PA 15219 USA
{rcolvin, tsh, djimison, bkj, emyers, tblaine}@andrew.cmu.edu
AR-based Modular Construction System for Automobile Advance Development
This paper describes the development of an AR-based modular construction system, which can be used within the phases of automobile advance development. The application completes real automobile prototypes by virtual components to show design variants or to support design reviews. Therefore the user can select virtual car components out of a virtual component menu and place them on a real car. The interaction with the AR-scene is done by hand gestures. The evaluation of the applications was done at Volkswagen AG, department of commercial vehicles, a German automobile manufacturer.
J. Gausemeier, C. Matysczok and R. RadkowskiDepartment of Computer Integrated Manufacturing
Heinz Nixdorf Institute, University of PaderbornPaderborn, Germany
{juergen.gausemeier|carsten.matysczok|rafael.radkowski}@hni.upb.de
Collaborative Augmented Sketching
The aim of this paper is to demonstrate a software prototype using AR Toolkit for collaborative augmented reality sketching in architectural design. I introduce a non-intrusive interaction technique developed for this prototype. Additionally, sketching and distribution mechanisms will be discussed and illustrated. The prototype uses non-photo-realistic rendering and an adaptive tessellation mechanism in the geometry kernel to provide a visual cue for the conceptual stage of an architectural design.
Hartmut SeichterDepartment of Architecture
The University of Hong [email protected]
MagicCup: A Tangible Interface for Virtual Objects Manipulation in Table-Top
In this demonstration, we show a tangible interface for virtual object manipulation in table-top augmented reality based on ARToolKit. This demonstration is designed for city planning. Augmented reality technology enables users to consider of city plans more effectively and easily. One important issue of the augmented reality environment is how user can manipulate 3D structures that are displayed as virtual objects. It has to be intuitive and easy so that it may not disturb user's thought. We propose a new direct manipulation method based on tangible user interface. User holds a transparent cup upside down and can pick up, move or delete a virtual object by using it.
Hirokazu Kato, Keihachiro Tachibana,Masaaki Tanabe, Takeaki Nakajima, Yumiko Fukuda
Osaka University, Hiroshima City University,Knack Images Production Center,Hiroshima Institute of Technology
[email protected],[email protected],
ISMAR03ISMAR03
Authoring of a Mixed Reality Assembly Instructor for Hierarchical Structures Mixed Reality is a very useful and powerful instrument for the
visualization of processes, including the assembly process. A Mixed Reality based step-by-step furniture assembly application is introduced. On the one hand context related actions are given to the user to install elements. On the other hand an intuitive way for authors to create new MR based assembly instructions is provided. Our goal is to provide a powerful, flexible and easy-to-use Authoring Wizard for assembly experts, allowing them to author their new assembly instructor for hierarchical structures. This minimizes the costs for the creation of new Mixed Reality Assembly Instructors.
Jurgen Zauner, Michael Haller, Alexander [email protected]
Upper Austria University of Applied Sciences (MTD)4232 Hagenberg, Austria
Werner [email protected]
Institute for Applied Knowledge Processing (FAW)4040 Linz, Austria
Interactive Mediated Reality
Mediated reality describes the concept of filtering our vision of reality, typically using a head-worn video mixing display. In this paper, we propose a generalized concept and new tools for interactively mediated reality. We present also our first prototype system for painting, grabbing and glueing together real and virtual elements.
Raphael Grasset, Jean-Dominique GascueliMAGIS/GRAVIR
INRIA Rhone-Alpes 655, Avenue de l’Europe38330 Montbonnot, France
Raphael.Grasset,[email protected]
Dieter SchmalstiegInteractive Media System GroupVienna University of Technology
Favoritenstrasse 9-11/188/2 A-1040 Vienna, [email protected]
The Augmented Composer Project: The Music Table The Music Table enables the composition of musical
patterns by arranging cards on a tabletop. An overhead camera allows the computer to track the movements and positions of the cards and to provide immediate feedback in the form of music and on-screen computer generated images. Musical structure is experienced as a tangible space enriched with physical and visual cues about the music produced.
Rodney Berry, Mao Makino, Naoto Hikawa, Masumi SuzukiATR Media Information Science Laboratories
ISMAR04ISMAR04
Collaborative Mixed Reality Visualization of an Archaeological Excavation
We present VITA (Visual Interaction Tool for Archaeology), an experimental collaborative mixed reality system for offsite visualization of an archaeological dig. Our system allows multiple users to visualize the dig site in a mixed reality environment in which tracked, see-through, head-worn displays are combined with a multi-user, multi-touch, projected table surface, a large screen display, and tracked hand-held displays. We focus on augmenting existing archaeological analysis methods with new ways to organize, visualize, and combine the standard 2D information available from an excavation (drawings, pictures, and notes) with textured, laser rangescanned 3D models of objects and the site itself. Users can combine speech, touch, and 3D hand gestures to interact multimodally with the environment.
Hrvoje Benko Edward W. Ishak Steven FeinerDepartment of Computer Science, Columbia University
New York, NY 10027{benko, ishak, feiner}@cs.columbia.edu
www.cs.columbia.edu/graphics
Immersive Authoring of Tangible Augmented Reality Applications
In this paper we suggest a new approach for authoring tangible augmented reality applications, called ‘immersive authoring.’ The approach allows the user to carry out the authoring tasks within the AR application being built, so that the development and testing of the application can be done concurrently throughout the development process. We describe the functionalities and the interaction design for the proposed authoring system that are specifically targeted for intuitive specification of scenes and various object behaviors. Several cases of applications developed using the authoring system are presented. A small pilot user study was conducted to compare the proposed method to a non-immersive approach, and the results have shown that the users generally found it easier and faster to carry out authoring tasks in the immersive environment.
Gun A. Lee α Claudia Nelles βMark Billinghurst β Gerard Jounghyun Kim α
α Virtual Reality Laboratory, Pohang University of Science and Technologyβ Human Interface Technology Laboratory New Zealand, University of Canterbury
α {endovert, gkim}@postech.ac.kr β {claudia.nelles, mark.billinghurst}@hitlabnz.org
Level of Detail Interfaces
We present the novel level of detail interface based on the marriage of level of detail geometry and an adaptable user interface. Level of detail interfaces allow applications to paramaterize their display of data and interface widgets with respect to distance from the camera, to best take advantage of diminished screen space in a 3D environment.
Stephen DiVerdi, Tobias H¨ollerer, Richard SchreyerDepartment of Computer Science
University of California, Santa Barbara, CA 93106{sdiverdi,holl,richards}@cs.ucsb.edu
OtherprojectsOtherprojects
AMIRE
The main objective of AMIRE is to enable non-expert researchers: to use Mixed Reality (MR) for their applications and to create and modify these MR applications with the support of dedicated tools
that foster an efficient authoring process for MR. This is the key for a more widespread use of MR, for a transfer of MR into different
application domains, for exploiting synergies between different MR methodologies and for establishing authoring itself as a new application domain for MR.
With authoring tools that employ MR, users are given means to efficiently communicate their ideas. An objective of AMIRE is also to set up and exploit a business scenario where a MR provider produces MR content for a customer.
http://www.amire.net/
DART: The Designer’s Augmented Reality Toolkit
This demonstration will highlight the Designer’s Augmented Reality Toolkit (DART), a system that allows users to easily create augmented reality (AR) experiences. Over the past year our research has been focused on the creation of this toolkit that can be used by technologists, designers, and students alike to rapidly prototype AR applications. Current approaches to AR development involve extensive programming and content creation as well as knowledge of technical topics involving cameras, trackers, and 3D geometry. The result is that it is very difficult even for technologists to create AR experiences. Our goal was to eliminate these obstacles that prevent such users from being able to experiment with AR. The DART system is based on the Macromedia Director multimedia-programming environment, the defacto standard for multimedia content creation. DART uses the familiar Director paradigms of a score, sprites and behaviors to allow a user to visually create complex AR applications. DART also provides low-level support for the management of trackers, sensors, and camera via a Director plug-in Xtra.
http://www.gvu.gatech.edu/dart/
Blair MacIntyre, Maribeth Gandy, Jay Bolter, Steven Dow, Brendan Hannigan
GVU Center, Georgia Institute of Technology, Atlanta, GA(blair, maribeth,steven,brendan)@cc.gatech.edu,
DesignAR
DesignAR allows a way of authoring augmented reality environments without needing to write code in C++ or other programming languages.
The environment centers around Touch Designer, a commercial 3D modelling package by Derivative www.derivativeinc.com
Based on the MXR toolkit programming libraries, our program uses a video camera to track special markers and send their positions and rotations to Touch Designer. The models are positioned in relation to the 'virtual camera' in Touch Designer and placed in front of a background of live video. This creates the illusiion of CG objects in the real world.
Touch designer allows complex interaction to be developed on-the-fly. The image below shows a particle system of envelopes being blown by a rotating fan. The fan and the particles can be moved around by manipulating the markers.
http://www.mis.atr.co.jp/~rodney/designAR/index.htm
The MagicBook - Moving Seamlessly between Reality and Virtuality
Mark BillinghurstUniversity of Washington
Hirukazu, KatoHiroshima City University
Ivan PoupyrevSony Computer Science Laboratories
MagicMouse: an Inexpensive 6-Degree-of-Freedom Mouse
An inexpensive computer input device was developed that allows the user to operate within both 2D and 3D environments by simply moving and rotating their fist. Position and rotation around the X, Y and Z-axes are supported, allowing full six degree of freedom input. This is achieved by having the user wear a glove, to which is attached a square marker. Translation and rotation of the hand is tracked by a camera attached to the computer, using the ARToolKit software library. Extraction, calibration, normalisation and mapping of the data converts hand motion into meaningful operations within 2D and 3D environments. Four input scenarios are described, showing that the mapping of the position and rotation data to 2D or 3D operations depends heavily on the desired task.
Eric WoodsHIT Lab NZ
Paul MasonLincoln University, New Zealand
Mark BillinghurstHIT Lab NZ
![ÁREA TEMÁTICA: Sociologia da Educação [ST]historico.aps.pt/viii_congresso/VIII_ACTAS/VIII_COM0852.pdf · alan.stoleroff@iscte.pt SANTOS, Patrícia Mestre em Sociologia da Educação](https://img.dokumen.tips/doc/110x75/5bcafe0009d3f26d178dc142/area-tematica-sociologia-da-educacao-st-alanstoleroffisctept-santos.jpg)
