Abstract
In this paper, we tackle the vehicle Re-identification (Re-ID) problem, which is important in the urban surveillance. Utilizing visual appearance information is limited on performance due to occlusions, illumination variations, etc. To make the best of our knowledge, the recent few methods consider the spatiotemporal information to solve vehicle Re-ID problem, and neglect the influence of driving direction. In this paper, we explore that the spatiotemporal distribution of vehicle movements follows certain rules, moreover the vehicles’ poses on camera view indicate their directions are closely related to the spatiotemporal cues. Inspired by these two observations, we propose a vehicles’ Poses Guide Spatiotemporal model (PGST) for assisting vehicle Re-ID. Firstly, a Gaussian distribution based spatiotemporal probability model is exploited to predict the vehicle’s spatiotemporal movement. Then a CNN embedding poses classifier is exploited to estimate driving direction by evaluating vehicle’s pose. Finally, PGST model is integrated into the framework which fuses the results of visual appearance model and spatiotemporal model together. Due to the lack of vehicle dataset with spatiotemporal information and topology of cameras, experiments are conducted on a public vehicle Re-ID dataset which is the only one meeting the experiments requirements. The proposed approach achieves competitive performances.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Zheng, L., Yang, Y., Hauptmann, A.G.: Person re-identification: past, present and future. arXiv preprint arXiv:1610.02984 (2016)
Wang, Z., Hu, R., et al.: Statistical inference of gaussian-laplace distribution for person verification. In: ACM Proceedings of the 2017 ACM on Multimedia Conference (ACMMM), vol. 9, pp. 1609–1617 (2017)
Wang, Z., Ye, M., Yang, F., et al.: Cascaded SR-GAN for scale-adaptive low resolution person re-identification. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI), vol. 18, pp. 3891–3897 (2018)
Wang, Z., Hu, R., Chen, C., et al.: Person re-identification via discrepancy matrix and matrix metric. IEEE Trans. Cybern. 48, 3006 (2017)
Feris, R.S., et al.: Large-scale vehicle detection, indexing, and search in urban surveillance videos. IEEE Trans. Multimedia (TMM) 14, 28–42 (2012)
Liu, X., Liu, W., Ma, H., Fu, H.: Large-scale vehicle re-identification in urban surveillance videos. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2016)
Liu, X., Liu, W., Mei, T., Ma, H.: A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 869–884. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_53
Liu, X., et al.: RAM: a region-aware deep model for vehicle re-identification. In: IEEE International Conference on Multimedia and Expo (ICME), arXiv preprint arXiv:1806.09283 (2018)
Liu, H., Tian, Y., Wang, Y., Pang, L., Huang, T.: Deep relative distance learning: tell the difference between similar vehicles. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2167–2175 (2016)
Wang, Z., et al.: Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification. In: IEEE International Conference on Computer Vision (ICCV), pp. 379–387 (2017)
Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circ. Syst. Video Technol. (TCSVT) 23, 311–325 (2013)
Wen, Y., Lu, Y., Yan, J., Zhou, Z., von Deneen, K.M., Shi, P.: An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans. Intell. Transp. Syst. (TITS) 12, 830–845 (2011)
Liu, X., Liu, W., Mei, T., Ma, H.: PROVID: progressive and multimodal vehicle re-identification for large-scale urban surveillance. IEEE Trans. Multimedia (TMM) 20, 645–658 (2018)
Huang, W., Hu, R., Liang, C., Yu, Y., Wang, Z., Zhong, X., Zhang, C.: Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations. In: Tian, Q., Sebe, N., Qi, G.-J., Huet, B., Hong, R., Liu, X. (eds.) MMM 2016. LNCS, vol. 9516, pp. 174–186. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-27671-7_15
Martinel, N., Foresti, G.L., Micheloni, C.: Person re-identification in a distributed camera network framework. IEEE Trans. Cybern. 47, 3530–3541 (2017)
Javed, O., Shaque, K., Rasheed, Z., Shah, M.: Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views. Comput. Vis. Image Underst. (CVIU) 109, 146–162 (2008)
Lv, J., Chen, W., Li, Q., Yang, C.: Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7948–7956 (2018)
Kettnaker, V., Zabih, R.: Bayesian multi-camera surveillance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPRW) vol. 2, p. 259 (1999)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
Zheng, Z., Zheng, L., Yang, Y.: A discriminatively learned CNN embedding for person re-identification. In: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 14, p. 13 (2017)
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification. a benchmark. In: IEEE International Conference on Computer Vision (ICCV), pp. 1116–1124 (2015)
Liao, S., Hu, Y., Zhu, X., Li, S.: Person re-identification by local maximal occurrence representation and metric learning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2197–2206 (2015)
Yang, L., Luo, P., Loy, C.C., Tang, X.: A large-scale car dataset for fine-grained categorization and verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3973–3981 (2015)
Acknowledgement
The research was supported by National Nature Science Foundation of China (61572012, 61801335), Hubei Provincial Natural Science Foundation of China (2015CFB52, 2017CFA012).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhong, X., Feng, M., Huang, W., Wang, Z., Satoh, S. (2019). Poses Guide Spatiotemporal Model for Vehicle Re-identification. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11296. Springer, Cham. https://doi.org/10.1007/978-3-030-05716-9_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-05716-9_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05715-2
Online ISBN: 978-3-030-05716-9
eBook Packages: Computer ScienceComputer Science (R0)