6
AR AR AR AR AR Navigation System Using Handheld Projector in Indoor Environment Akira NAGAMATSU Yuusuke NAKAZATO Masayuki KANBARA Naokazu YOKOYA Graduate School of Information Science, Nara Institute of Science and Technology Abstract: This paper proposes a projection-based AR navigation system which guides users by using a handheld projector in indoor environments. The projection-based AR navigation system projects guidance of exhibits onto a wall or a floor in the real world. In order to realize this system, it is necessary to measure position and orientation of a projector precisely in a wide area. In the proposed navigation system, the projector’s position and orientation are estimated from images observed invisible markers which are set up on ceilings with an infrared camera attached to the projector. In addition, the proposed system can guide users according to the course that the user selected and situation of the users. 1 AR [1–4] (HMD Head Mounted Display) HMD AR PDA(Personal Digital Assistant) AR [5–7] AR [8] AR 1

AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

AR

ARAR

AR

AR Navigation System Using Handheld Projector

in Indoor EnvironmentAkira NAGAMATSU Yuusuke NAKAZATO Masayuki KANBARA Naokazu YOKOYA

Graduate School of Information Science, Nara Institute of Science and Technology

Abstract:This paper proposes a projection-based AR navigation system which guides users by using a handheldprojector in indoor environments. The projection-based AR navigation system projects guidance of exhibitsonto a wall or a floor in the real world. In order to realize this system, it is necessary to measure positionand orientation of a projector precisely in a wide area. In the proposed navigation system, the projector’sposition and orientation are estimated from images observed invisible markers which are set up on ceilingswith an infrared camera attached to the projector. In addition, the proposed system can guide usersaccording to the course that the user selected and situation of the users.

1

AR [1–4]

(HMD Head MountedDisplay) HMD

AR

PDA(PersonalDigital Assistant) AR [5–7]

AR[8] AR

1

Page 2: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

1:

AR[9]

[10,11]

2

AR

1

( )( )

3

( )

� � �

� � � � � � � �

� � � � � � � �

� � � � � � � � � � � � � � �

� ! � � � "

# $ � �%

& � '

� ( � ) * + , - .

� / 0 1 � 2

� 3 4 5 � �

6 7 8 9 � � :%

� ; ;

# $ � 2%

< � '

= > ? @ � � A � � � B C

� D E � & :%

� C � F G H � I J ; ;

K = L � ( � M H K

= L N � O

P Q R S

T U V � � 2 � & C J :

# $ � 2%

2 < W '

X . Y Z [ \ ]

^ _ B 2 " 1

� ` � � � a �

� � �

� � � � � � � �

� � � � � � � �

� � � � � � � � � � � � � � �

� ! � � � "

# $ � �%

& � '

� ( � ) * + , - .

� / 0 1 � 2

� 3 4 5 � �

6 7 8 9 � � :%

� ; ;

# $ � 2%

< � '

= > ? @ � � A � � � B C

� D E � & :%

� C � F G H � I J ; ;

� ( � ) * + , - .

� / 0 1 � 2

� 3 4 5 � �

6 7 8 9 � � :%

� ; ;

# $ � 2%

< � '

= > ? @ � � A � � � B C

� D E � & :%

� C � F G H � I J ; ;

K = L � ( � M H K

= L N � O

P Q R S

T U V � � 2 � & C J :

# $ � 2%

2 < W '

K = L � ( � M H K

= L N � O

P Q R S

T U V � � 2 � & C J :

# $ � 2%

2 < W '

K = L � ( � M H K

= L N � O

P Q R S

T U V � � 2 � & C J :

# $ � 2%

2 < W '

X . Y Z [ \ ]

^ _ B 2 " 1

� ` � � � a �

2:

(a)(b)

( )

3:

2.1

2

LED3

( 9mm 0.5 )

2

2.2

2

Page 3: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

� � � � � � � � � � � � � � � �

� � � � � � � � �

� � � � � � � � � � �� � � � � � � � � � � � � � � �

� � � � � � � � �

� � � � � � � � � � �

4:

•4

4(1)

4(2)

5

� � � � �� � � � �� � � � �� � � � � � �� �� �� �� � � �� � � �� � � �� � � �

� � �� � �� � �� � �

� � � � � �� � � � � �

� � �� � �

� � � � �� � � � �� � � � �� � � � � � �� �� �� �� � � � �� � � � �� � � � �� � � � � � �� �� �� �� � � �� � � �� � � �� � � �� � � �� � � �� � � �� � � �

� � �� � �� � �� � �� � �� � �� � �� � �

� � � � � �� � � � � �

� � �� � �

(a)

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

� � �� � �� � �� � �� � �� � �� � �� � �

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

� � �� � �� � �� � �� � �� � �� � �� � �

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �� � � � � �

(b)

5:

•3

3

Page 4: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

� � � � � � �� �

� � � � � � � � �

� � � � � �

� � � � � � � � � !

� " � # $ %

& '& '& '& '( '( '( '( '

& '& '& '& '( '( '( '( '

) * + ,) * + ,) * + ,) * + , -- -- . / 0. / 0. / 0. / 0 12 3 4 5 6 7 8 9 : ; < < <

= > ? @ A B ? @ C B ? D >

E F 4 5 G 7 8 9 : ; < < <= > ? @ H B ? @ I B ? @ J B ? @ A B ? @ C B ? D >

� K � � � � � � � �

� L M N L O

� P � � � � � � � !

� % Q R S � T

� � � � � � � � �

� � � � � �

� U � � � V W X Y � !

� $ Z [ \ ]

� � � � � � � � � !

� " � # $ %

^ _ + ,^ _ + ,^ _ + ,^ _ + , -- -- ` / a` / a` / a` / a 1@ A B

b@ C B < < < c d e 4 2 3 4 5 6

@ H Bb

@ I B < < < f g h i j k 5 G

@ J B < < < f g l m n o 5 G

p q r s t �

u v w

u w

� � � � � � �� �

� � � � � � � � �

� � � � � �

� � � � � � � � � !

� " � # $ %

& '& '& '& '( '( '( '( '

& '& '& '& '( '( '( '( '

& '& '& '& '( '( '( '( '

& '& '& '& '( '( '( '( '

) * + ,) * + ,) * + ,) * + , -- -- . / 0. / 0. / 0. / 0 12 3 4 5 6 7 8 9 : ; < < <

= > ? @ A B ? @ C B ? D >

E F 4 5 G 7 8 9 : ; < < <= > ? @ H B ? @ I B ? @ J B ? @ A B ? @ C B ? D >

) * + ,) * + ,) * + ,) * + , -- -- . / 0. / 0. / 0. / 0 12 3 4 5 6 7 8 9 : ; < < <

= > ? @ A B ? @ C B ? D >

E F 4 5 G 7 8 9 : ; < < <= > ? @ H B ? @ I B ? @ J B ? @ A B ? @ C B ? D >

� K � � � � � � � �

� L M N L O

� K � � � � � � � �

� L M N L O

� K � � � � � � � �

� L M N L O

� P � � � � � � � !

� % Q R S � T

� P � � � � � � � !

� % Q R S � T

� � � � � � � � �

� � � � � �

� � � � � � � � �

� � � � � �

� � � � � � � � �

� � � � � �

� U � � � V W X Y � !

� $ Z [ \ ]� U � � � V W X Y � !

� $ Z [ \ ]

� � � � � � � � � !

� " � # $ %

� � � � � � � � � !

� " � # $ %

^ _ + ,^ _ + ,^ _ + ,^ _ + , -- -- ` / a` / a` / a` / a 1@ A B

b@ C B < < < c d e 4 2 3 4 5 6

@ H Bb

@ I B < < < f g h i j k 5 G

@ J B < < < f g l m n o 5 G

^ _ + ,^ _ + ,^ _ + ,^ _ + , -- -- ` / a` / a` / a` / a 1@ A B

b@ C B < < < c d e 4 2 3 4 5 6

@ H Bb

@ I B < < < f g h i j k 5 G

@ J B < < < f g l m n o 5 G

p q r s t �

u v w

u w

6:

3

3.1

( 2.8m)

(Lenovo ThinkPad X61 CPU:2GHz:2GB) LED ( )

(LVP-PK20)

6

•(1) (3) (5)

� � � � � � � �

� � � � �

� � � � � � � �

� � � � � �

� � � � � � � � � � �

� � � � � !

� " � � � � � � � � �

� # � $ % �

� & � � � ' ( ) * � �

� % + , - .

/ 0 1 21 3

4

5

6 77 77 8 9 : ; ; ; < = > ? @ A B C D E F G H I JK LK LK LK L ; ; ; M N O P Q R @ A B S T

U V W

� � � � � � � �

� � � � �

� � � � � � � �

� � � � � �

� � � � � � � � � � �

� � � � � !

� " � � � � � � � � �

� # � $ % �

� & � � � ' ( ) * � �

� % + , - .

/ 0 1 21 3

4

5

6 77 77 8 9 : ; ; ; < = > ? @ A B C D E F G H I JK LK LK LK L ; ; ; M N O P Q R @ A B S T

U V W

7:

(1) (5)(1)

(5)

•(3)

3.2

7

8 A

B E9

C G10(a) (b)

H 11

4

Page 5: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

(a) (b)

8: A

(a) B (b) E

9: B E

•C 12

(1) 12(a)

12(b)

•D(1)13 13(a) (5)

(1) (5)13(b)

•F1 F2 (3)

(a) C (b) G

10: C G

11: H

1415

4

AR

45

3

5

Page 6: AR Navigation System Using Handheld Projector in Indoor …yokoya.naist.jp/paper/datas/1032/sig_cs2008_2_29.pdf · 2013-02-14 · AR Navigation System Using Handheld Projector in

(a) (b)

12: C

(a) (1) (b)

13: D

[1] S. Long, K. Kooper, G. D. Abowd and C. G. Atke-son “Rapid Prototyping of Mobile Context-AwareApplications: The Cyberguide Case Study,” Proc.2nd Int. Conf. On Mobile Computing and Network-ing, pp. 97 - 107, 1996.

[2] R. Malaka and A. Zipf “Deep Map Challenging ITResearch in the Framework of a Tourist Informa-tion System,” Proc. 7th Int. Congress on Tourismand Communications, pp. 15 - 27, 2000.

[3] D. stricker, J. Karigiannis, I. T. Christou, T. Gleueand N. Ioannidis: “Augmented reality for visitorsof cultural heritage sites, ” Proc. Int. Conf. on Cul-tural and Scientific Aspects of Experimental MediaSpaces, pp. 89 - 83, 2001.

[4] R. Tenmoku, M. Kanbara and N. Yokoya: “NaraPalace Site Navigator, ” Device-indepent Human

14: F1

15: F2

Navigation Using a Networked Shared Database,Proc. 10th Int. Conf. On Virtual Systems and Mul-timedia, pp. 1234 - 1242, 2004.

[5] R. Oppermann and M. Specht “Adaptive MobileMuseum Guide for Information and Learning onDemand,” Proc. 8th Int. Conf. Human ComputerInteraction, pp. 642 - 646, 1999.

[6] K. Cheverst, N. Davies, K. Mitchell, A. Friday andC. Efstatiou “Developing a Context-aware Elec-tronic Tourist Guide: Some Issues and Experi-ences,” Proc. SIGCHI Conf. on Human Factors inComputering Systems, pp. 17 - 24, 2000.

[7] M. Kalkusch, T. Lidy, M. Knapp, G. Reitmayr,H. Kaufmann, and D. Schmalstieg: “StructuredVisual Markers for Indoor Pathfinding,” Proc.IEEE. Int. Workshop on ARToolKit (ART02),2002.

[8] : “”

2003 - CVIM - 140 pp. 141 - 46 2003.

[9] : “AR

” 2007 -MVE - 50 pp. 73 - 78 2007.

[10] : “

”Vol. 10 No. 3 pp. 295 - 304 2005.

[11] : “”

2007 - MVE - 50 pp. 73- 78 2007.

6