This paper illustrates a novel registration method for augmented reality systems based on multiplanar structures and natural feature tracking. Our method distinguishes itself from other methods in the following ways: First, our method can use arbitrary multiple planes without any information on the physical relationship of the planes. Second, we put forward a new method to establish the world coordinate system. Compared with the traditional method, our approach needs only three noncollinear points of the real world and really enhances the usability of our system. Third, we propose novel classification based local and global tracking strategies to match features between reference images and the current frame directly. Our method casts off the requirement that the initial camera position should be close to the reference images while overcoming the problem of error accumulation. Some experiments have been carried out to demonstrate the validity of the proposed approach.

1.
Azuma
,
R. T.
, 1997, “
A Survey of Augmented Reality
,”
Presence-Teleoperators and Virtual Environments
,
6
(
4
), pp.
355
385
.
2.
Azuma
,
R. T.
, 2001, “
Recent Advances in Augmented Reality
,”
IEEE Comput. Graphics Appl.
0272-1716,
21
(
6
), pp.
34
47
.
3.
State
,
A.
,
Hirota
,
G.
,
Chen
,
D.
,
Garett
,
W.
, and
Livingston
,
M.
, 1996, “
Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking
,”
Proceedings of the SIGGRAPH
,
New Orleans
, pp.
429
438
.
4.
Seo
,
Y.
, and
Hong
,
K. S.
, 2000, “
Calibration-Free Augmented Reality in Perspective
,”
IEEE Trans. Vis. Comput. Graph.
1077-2626,
6
(
4
), pp.
346
359
.
5.
Billinghurst
,
M.
,
Cambell
,
S.
,
Poupyrev
,
I.
,
Takahashi
,
K.
,
Kato
,
H.
, and
Hendrickson
,
D.
, 2000, “
Magic Book: Exploring Transitions in Collaborative Ar Interfaces
,”
Proceedings of the SIGGRAPH
,
New Orleans
, p.
87
.
6.
Genc
,
Y.
,
Riedel
,
S.
,
Souvannavong
,
F.
,
Navab
,
N.
, and
Akinlar
,
C.
, 2002, “
Marker-Less Tracking for Augmented Reality: A Learning-Based Approach
,”
Proceedings of the ISMAR
,
Darmstadt
, pp.
295
304
.
7.
Pang
,
Y.
,
Yuan
,
M. L.
,
Nee
,
A. Y. C.
, and
Ong
,
S. K.
, 2006, “
A Markerless Registration Method for Augmented Reality Based on Affine Properties
,”
Proceedings of the AUIC
,
Hobart, Tasmania
, pp.
25
32
.
8.
Yuan
,
M. L.
,
Ong
,
S. K.
, and
Nee
,
A. Y. C.
, 2006, “
Registration Using Natural Features for Augmented Reality Systems
,”
IEEE Trans. Vis. Comput. Graph.
1077-2626,
12
(
4
), pp.
569
580
.
9.
Simon
,
G.
, and
Berger
,
M.
, 2000, “
Markerless Tracking Using Planar Structures in the Scene
,”
Proceedings of the ISAR
,
Munich
, pp.
120
128
.
10.
Simon
,
G.
, and
Berger
,
M.
, 2002, “
Reconstructing While Registering: A Novel Approach for Markerless Augmented Reality
,”
Proceedings of the ISMAR
,
Darmstadt
, pp.
285
294
.
11.
Bartoli
,
A.
,
Tunzelmann
,
E.
, and
Zisserman
,
A.
, 2004, “
Augmenting Images of Non-Rigid Scenes Using Point and Curve Correspondences
,”
Proceedings of the CVPR
,
Washington, DC
, Vol.
1
, pp.
699
706
.
12.
Comport
,
A. I.
,
Marchand
,
E.
, and
Chaumette
,
F.
, 2003, “
A Real Time Tracker for Markerless Augmented Reality
,”
Proceedings of the ISMAR
,
Tokyo
, pp.
36
45
.
13.
Yuan
,
M. L.
,
Ong
,
S. K.
, and
Nee
,
A. Y. C.
, 2005, “
Registration Based on Projective Reconstruction Technique for Augmented Reality Systems
,”
IEEE Trans. Vis. Comput. Graph.
1077-2626,
11
(
3
), pp.
254
264
.
14.
Zhang
,
Z.
, 1998, “
Determining the Epipolar Geometry and Its Uncertainty: A Review
,”
Int. J. Comput. Vis.
0920-5691,
27
(
2
), pp.
161
198
.
15.
Zhang
,
Z.
,
Deriche
,
R.
,
Faugeras
,
O.
, and
Luong
,
Q. T.
, 1995, “
A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry
,”
Artif. Intell.
0004-3702,
78
, pp.
87
119
.
16.
Harris
,
C.
, and
Stephens
,
M.
, 1988, “
A Combined Corner and Edge Detector
,”
Proceedings of the Fourth Alvey Vision Conference
,
Manchester
, pp.
147
151
.
17.
Lepetit
,
V.
,
Pilet
,
J.
, and
Fua
,
P.
, 2004, “
Point Matching as a Classification Problem for Fast and Robust Object Pose Estimation
,”
Proceedings of the CVPR
,
Washington, DC
, Vol.
2
, pp.
244
250
.
18.
Hartley
,
R.
, and
Zisserman
,
A.
, 2000,
Multiple View Geometry in Computer Vision
,
Cambridge University Press
,
Cambridge, UK
.
19.
Fischler
,
M. A.
, and
Bolles
,
R. C.
, 1981, “
Random Sample Concensus: A Paradigm for Model Fitting With Applications to Image Analysis and Automated Cartography
,”
Commun. ACM
0001-0782,
24
, pp.
381
395
.
You do not currently have access to this content.