Indoor Localization Methods Using Dead Reckoning and 3D Map Matching

  • View

  • Download

Embed Size (px)

Text of Indoor Localization Methods Using Dead Reckoning and 3D Map Matching

  • Indoor Localization Methods Using Dead Reckoning and 3DMap Matching

    J. Bojja & M. Kirkko-Jaakkola & J. Collin & J. Takala

    Received: 29 September 2013 /Revised: 27 November 2013 /Accepted: 2 December 2013# Springer Science+Business Media New York 2013

    Abstract In order to navigate or localize in 3D space such asparking garages, we would need height information in addi-tion to 2D position. Conventionally, an altimeter is used to getthe floor level/height information.We propose a novel methodfor three-dimensional navigation and localization of a landvehicle in a multi-storey parking-garage. The solution pre-sented in this paper uses low cost gyro and odometer sensors,combined with a 3D map by means of particle filtering andcollision detection techniques to localize the vehicle in aparking garage. This eliminates the necessity of an altimeteror other additional aiding sources such as radio signalling.Altimeters have inherent dynamic influential factors such astemperature and environmental pressure affecting the altitudereadings, and for radio signals we need extra infrastructurerequirements. The proposed solution can be used without anysuch additional infrastructure devices. Other sources of infor-mation, such as WLAN signals, can be used to complementthe solution if and when available. In addition we extend thisproposedmethod to novel concept of non-stationary 3Dmaps,as moving maps, within which localization of a track-ableobject is required. We also introduce novel techniques thatenable seamless navigation solution from vehicular dead reck-oning (VDR) to pedestrian dead reckoning (PDR) and viceversa to reduce user involvement. For achieving this wecollect relevant measurements such as vehicle ignition statusand accelerometer signal variance, and user pattern recogni-tion to select appropriate dead reckoning method.

    Keywords Particle filters . 3Dmapmatching . Deadreckoning . Land vehicles . Sensor fusion . Indoorenvironments

    1 Introduction

    Current navigation solutions employ one or several of thetechniques based on GNSS satellites and receivers, WLANdevices, inertial sensors, altimeters, and video [1]. For clear-sky out-door navigation, GNSS alone will suffice for anaccurate navigation solution. However in environments whereGNSS is totally unavailable, such as underground parkinggarages, the location information needs to be derived fromother sources such as wireless radio devices, motion sensors,and altimeters [2] [3]. Using altimeters might not be feasible,as they have inherent dynamic influential factors such astemperature and environmental pressure affecting the altitudereadings [4].

    In this paper, we study 3Dmap-matching in parking garages,a scenario different from the common map-matching problemin various senses. Firstly, in parking garages, GNSS cannot berelied on due to the heavy attenuation of satellite signals whenpenetrating concrete structures; therefore, one has to resort tousing on-board motion sensors such as the odometer of thevehicle. Secondly, vehicle heading is less constrained than onroads and streets, which poses additional challenges when agyroscope is used for heading estimation. Thirdly, positioninginmulti-storey parking garages requires the use of 3Dmaps andknowledge on the altitude of the vehicle.

    This paper proposes a method for achieving low cost andeffective solution to such GNSS denied indoor multi-storeyparking garage navigation. Many existing devices in the mar-ket, such as smartphones, are equipped with gyros, acceler-ometers, and all modern land vehicles (e.g., cars) have odom-eters. The speed information of the vehicle is obtained by asmart phone via a Bluetooth on-board diagnostics (OBD)reader supporting protocol version II connected to the vehicle.Given the nonholonomic constraints of vehicle motion and theinitial location of the vehicle with respect to the target indoor,these sensors readings and a detailed 3D map are sufficient to

    J. Bojja (*) :M. Kirkko-Jaakkola : J. Collin : J. TakalaDepartment of Pervasive Computing, Tampere University ofTechnology, Tampere, Finlande-mail:

    J Sign Process SystDOI 10.1007/s11265-013-0865-9

  • obtain an indoor 3D positioning solution on a smartphone.This paper extends our preliminary results reported in [5].

    A 3D model as depicted in Fig. 1(a), representing thestructural details of a real-world multi-storey parking garageshown in Fig. 1(b), is used as a 3D map and motion constraintin the solution which is based on particle filtering. In the filter,each particle is modelled as a separate 3D vehicle objectwhich has approximately the same horizontal and verticaldimensions as a true vehicle. This 3D vehicle object in itselfcan be used as a map within which localization is required.This enables us to localize the passengers inside movingvehicles such as trains, boats and busses, for example. Sincethese 3D maps of vehicles are moving with respect to theEarth-fixed frame wherein GNSS location is traditionallyexpressed, the term moving maps is used in this article.

    The rest of the paper is organized as follows. Section 2describes the related work, Sections 3 and 4 address theparticle filtering and collision detection methods upon whichthe proposed navigation algorithm relies. Section 5 describesthe technically extended novel concepts of moving maps andseamless navigation solution. Section 6 describes the mea-surement and experimental setup for testing, and demonstrat-ing the localization approach, using real-world sensor dataobtained by driving a car in parking garages. Finally, Section 7concludes the paper.

    2 Related Work

    Map-matching has been studied for decades, with the firstimplementations estimating the position of a vehicle along aknown route [6]; an extensive description of the most com-mon map-matching algorithms is given in [7].

    Many solutions to the 3D indoor positioning problem havebeen proposed in the literature. Wagner et al. [8] used cascad-ed Kalman filters and road link matching, for positioningvehicles in parking garages. In [9], Fouque et al. describes ageneric solution to multi-hypothesis map-matching usingglobal positioning on tightly integrated 3D navigable road

    maps, formalized in a general Bayesian framework. Pintoet al. [10] proposes a 3D map based approach to pinpoint arobot pose, by using 3D map of the surrounding environmentand data acquired by a tilting laser range finder.

    Nowadays, a popular approach is to use a particle filter(PF); they are known to be well suited for positioning prob-lems [11]. In [12], Fairfield et al. proposed a submap-based3D simultaneous localization and mapping (SLAM) known assegmented SLAM or SegSLAM, and used Cave Crawlerrobotic vehicle for obtaining speed and heading sample data,using on-board wheel based odometer and laser range mea-surement system respectively. The basic idea of segmentationis to circumvent the scale limitation inherent in SLAM. Theyapply Rao-Blackwellized particle filter for SLAM and extendit to allow particles to transition between sub maps. Kmmerleet al. [13] proposed an autonomous driving in a complexmulti-storey parking garage, using a modified vehicleequipped with multi laser range finders, a high-performanceinertial measurement unit and GPS receivers. They used a PFfor localizing (SLAM) the car in and within a 3D map of theparking garage environment by only using the laser range datafor generating the map and using the inertial data for the PFand localization. They have used 1000 particles and limitedthe speed of the vehicle to 10 km/h and an update of data at200Hz. However, the map information cannot be used as anefficient motion constraint in SLAM because the map is oneof the unknowns. Leppkoski et al. [14] proposed a pedestriandead reckoning solution for indoor pedestrian navigation withdetailed indoor maps as a motion constraint, inertial sensors asthe primary source of information, and radio signals asassisting signals. This study showed that a very detailed 2Dmap, including even bookshelves, significantly improved thePF navigation solution in a 2D space.

    3D models and map matching has been studied earlier. In[15] Andreja et al. proposed a mobile robot self-localization incomplex indoor environments using monocular vision and 3Dmodel of the environment. The captured noisy and complexvideo frames are processed for real time 2D image segmenta-tion and line extraction by using Canny edge detector and

    Figure 1 Multi-storey parking garage: a 3D model and b the real world garage.

    J Sign Process Syst

  • random window randomized Hough transform (RWRHT).The extracted edges are then matched with the 3D model linesegments to localize the robot. The odometry device in therobot is used to estimate the robots pose and use it as theestimated camera pose for rendering 3D model. Then edgematching procedure is applied to adjust this assumed camerapose that is rendering the 3D scene to match with the edges ofthe captured 2D image. Ascher et al. [3] proposed a multi floorindoor pedestrian navigation, where stairs, elevators and lad-ders are used for transitioning from floor to floor. This methoduses barometer, magnetometer/compass and inertial measure-ment units as sensor data input to the algorithm and particlefilter system based on bootstrap particle filter implementation[16]. Here a 3D model of the scenario (building) is used forcompensating for the errors of the sensors such as magneticinterference causing heading errors and the accumulated er-rors of accelerometer and gyro. There are several solutionproposals for automatic map generation, such as for 2D,2.5D, and 3D maps [1921, 2832].

    Our approach is to use a detailed 3D structural map of theparking garage depicted in Fig. 2(a), as a motion constraint tonavigate in 3D space using on-board motion sensors. In ourPF, we test each particl