Intelligent video analysis: A Pedestrian trajectory extraction method for the whole indoor space without blind areas.

Pedestrian trajectory extraction is an important part of intelligent monitoring, which is of great significance to many fields such as statistics on pedestrian flow and density, population behavior analysis, abnormal behavior detection, etc. However, it is quite challenging to extract pedestrian trajectory without blind areas in the whole space due to the limited view angle of ordinary cameras. So far, no efficient method has been proposed to deal with this problem. In this paper, we propose a pedestrian trajectory extraction method based on a single fisheye camera, which can realize no blind areas pedestrian trajectory extraction in the whole interior space. First, the fisheye camera with a perspective of 18 0 ∘ is adopted in our work which can realize the entire space monitoring without blind areas and avoid object matching among multiple cameras. Then, the deep convolutional neural network, the Kalman Filter algorithm, and the Hungarian algorithm are combined for pedestrian head detection and tracking. In order to calculate the coordinates of the trajectory points according to the obtained head position, we propose a novel pedestrian height estimation method for fisheye cameras. Finally, the pedestrian trajectory points are calculated based on the detected head position and the estimated height. The performance of the proposed pedestrian trajectory extraction method has been evaluated by a variety of experiments. The experimental results show that the trajectories of multiple pedestrians can be extracted simultaneously through the method proposed in this paper, and the average error of the trajectory points is less than 5.07 pixels in the 512 × 512 images. • In this paper, a pedestrian trajectory extraction method based on a single fisheye camera is proposed, which can realize pedestrian trajectory extraction in the whole interior space without blind areas. • An efficient pedestrian height estimation method based on the mathematical model of fisheye cameras is proposed in this paper. Based on the estimated height, the trajectory points of pedestrian can be calculated according to the detected head position. • The calculation methods of pedestrian trajectory points and bounding boxes for fisheye cameras are proposed in this paper. Based on this method, we can obtain the trajectory of pedestrians according to the results of pedestrian head and height estimation. • The pedestrian head detection dataset based on fisheye cameras (PHDF) is created specifically for the overlooking scene of the fisheye camera, which is available to all researchers. • Furthermore, head detection instead of body detection is adopted for pedestrian detection in this paper and a pedestrian head detection and tracking method based on the SORT algorithm is adopted for the overlooking scene of the fisheye camera. [ABSTRACT FROM AUTHOR]