1. Evaluating Indoor Positioning Systems in a Shopping Mall: The Lessons Learned From the IPIN 2018 Competition
- Author
-
Park, So Young [0000-0001-5491-6776], Ministry of Science and Technology of the People's Republic of China, European Commission, Institute of Information & Communications Technology Planning & Evaluation (South Korea), Japan Society for the Promotion of Science, Chinese Academy of Sciences, Renaudin, Valerie [0000-0003-4535-5406], Perul, Johan [0000-0003-1815-9872], Torres-Sospedra, Joaquín [0000-0003-4338-4334], Ramón Jiménez, Antonio [0000-0001-9771-1930], Pérez-Navarro, Antoni [0000-0002-7037-0635], Martín Mendoza-Silva, Germán [0000-0003-2744-0236], Seco, Fernando [0000-0002-2922-2710], Ye, Feng [0000-0001-9718-1255], Shvalb, Nir [0000-0001-8246-3727], Lu, Chuanhua [0000-0001-5399-5951], Park, Chan Gook [0000-0002-7403-951X], Opiela, Miroslav [0000-0001-8802-4442], Chien, Ying-Ren [0000-0002-3013-0290], Li, Yu [0000-0001-5144-6318], Niu, Xiaoji [0000-0002-5591-0859], Shimada, Atsushi [0000-0002-4108-770X], Renaudin, Valerie, Ortiz, Miguel, Perul, Johan, Torres-Sospedra, Joaquín, Ramón Jiménez, Antonio, Pérez-Navarro, Antoni, Martín Mendoza-Silva, Germán, Seco Granja, Fernando, Landau, Yael, Marbel, Revital, Ben-Moshe, Boaz, Zheng, Xingyu, Ye, Feng, Kuang, Jian, Li, Yu, Niu, Xiaoji, Landa, Vlad, Hacohen, Shlomi, Shvalb, Nir, Lu, Chuanhua, Uchiyama, Hideaki, Thomas, Diego, Shimada, Atsushi, Taniguchi, Rin-Ichiro, Ding, Zhenxing, Xu, Feng, Kronenwett, Nikolai, Vladimirov, Blagovest, Lee, Soyeon, Cho, Eunyoung, Jun, Sungwoo, Lee, Changeun, Park, Sanjoon, Lee, Yonghyun, Rew, Jehyeok, Park, Changjun, Jeong, Hyeongyo, Han, Jaeseung, Lee, Keumryeol, Zhang, Wenchao, Li, Xianghong, Wie, Dongyan, Zhang, Ying, Park, So Young, Park, Chan Gook, Knauth, Stefan, Pipelidis, Georgios, Tsiamitros, Nikolaos, Lungenstrass, Tomás, Morales, Juan Pablo, Trogh, Jens, Plets, David, Opiela, Miroslav, Fang, Shih-Hau, Tsao, Yu, Chien, Ying-Ren, Yang, Shi-Shen, Ye, Shih-Jyun, Ali, Muhammad Usman, Hur, Soojung, Park, Yongwan, Park, So Young [0000-0001-5491-6776], Ministry of Science and Technology of the People's Republic of China, European Commission, Institute of Information & Communications Technology Planning & Evaluation (South Korea), Japan Society for the Promotion of Science, Chinese Academy of Sciences, Renaudin, Valerie [0000-0003-4535-5406], Perul, Johan [0000-0003-1815-9872], Torres-Sospedra, Joaquín [0000-0003-4338-4334], Ramón Jiménez, Antonio [0000-0001-9771-1930], Pérez-Navarro, Antoni [0000-0002-7037-0635], Martín Mendoza-Silva, Germán [0000-0003-2744-0236], Seco, Fernando [0000-0002-2922-2710], Ye, Feng [0000-0001-9718-1255], Shvalb, Nir [0000-0001-8246-3727], Lu, Chuanhua [0000-0001-5399-5951], Park, Chan Gook [0000-0002-7403-951X], Opiela, Miroslav [0000-0001-8802-4442], Chien, Ying-Ren [0000-0002-3013-0290], Li, Yu [0000-0001-5144-6318], Niu, Xiaoji [0000-0002-5591-0859], Shimada, Atsushi [0000-0002-4108-770X], Renaudin, Valerie, Ortiz, Miguel, Perul, Johan, Torres-Sospedra, Joaquín, Ramón Jiménez, Antonio, Pérez-Navarro, Antoni, Martín Mendoza-Silva, Germán, Seco Granja, Fernando, Landau, Yael, Marbel, Revital, Ben-Moshe, Boaz, Zheng, Xingyu, Ye, Feng, Kuang, Jian, Li, Yu, Niu, Xiaoji, Landa, Vlad, Hacohen, Shlomi, Shvalb, Nir, Lu, Chuanhua, Uchiyama, Hideaki, Thomas, Diego, Shimada, Atsushi, Taniguchi, Rin-Ichiro, Ding, Zhenxing, Xu, Feng, Kronenwett, Nikolai, Vladimirov, Blagovest, Lee, Soyeon, Cho, Eunyoung, Jun, Sungwoo, Lee, Changeun, Park, Sanjoon, Lee, Yonghyun, Rew, Jehyeok, Park, Changjun, Jeong, Hyeongyo, Han, Jaeseung, Lee, Keumryeol, Zhang, Wenchao, Li, Xianghong, Wie, Dongyan, Zhang, Ying, Park, So Young, Park, Chan Gook, Knauth, Stefan, Pipelidis, Georgios, Tsiamitros, Nikolaos, Lungenstrass, Tomás, Morales, Juan Pablo, Trogh, Jens, Plets, David, Opiela, Miroslav, Fang, Shih-Hau, Tsao, Yu, Chien, Ying-Ren, Yang, Shi-Shen, Ye, Shih-Jyun, Ali, Muhammad Usman, Hur, Soojung, and Park, Yongwan
- Abstract
The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75 th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future.
- Published
- 2019