Identification of changes in remote sensing images plays an important role in many applications, such as monitoring the growth of urbanization, land use changes, and assessing disasters and natural damages. This process aims to assign the label "changed" or "not changed" to the pixels of two images taken from the same place but at two different times. On the other hand, in the last decade, deep learning methods have attracted the attention of many researchers in this field due to their proper performance in interpreting and processing remote sensing data and the ability to remove feature engineering and extract high-level features from images. In this regard, in this article, an optimal deep learning model has been designed, which increases the accuracy of identifying changes in two-time images due to its hierarchical structure, appropriate efficiency of multiscale features, and effective design of feature transfer. Due to the optimal structure and architecture, the proposed model has higher speed and accuracy of results compared to some popular models such as BIT. Applying the proposed model to the two data sets under investigation indicates an average accuracy of 96% and less complex calculations.
Type of Study: Research |
Subject: Photo&RS Received: 2023/06/14
References
1. C. Zhang et al., "A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 166, pp. 183-200, 2020/08/01/ 2020, doi:
https://doi.org/10.1016/j.isprsjprs.2020.06.003 [DOI:10.1016/j.isprsjprs.2020.06.003.]
2. H. Chen, Z. Qi, and Z. Shi, "Remote sensing image change detection with transformers," IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2021. [DOI:10.1109/TGRS.2021.3095166]
3. B. DeVries, M. Decuyper, J. Verbesselt, A. Zeileis, M. Herold, and S. Joseph, "Tracking disturbance-regrowth dynamics in tropical forests using structural change detection and Landsat time series," Remote Sensing of Environment, vol. 169, pp. 320-334, 2015. [DOI:10.1016/j.rse.2015.08.020]
4. S. Wang, D. Quan, X. Liang, M. Ning, Y. Guo, and L. Jiao, "A deep learning framework for remote sensing image registration," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 145, pp. 148-164, 2018. [DOI:10.1016/j.isprsjprs.2017.12.012]
5. M. Zhang and W. Shi, "A feature difference convolutional neural network-based change detection method," IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 10, pp. 7232-7246, 2020. [DOI:10.1109/TGRS.2020.2981051]
6. K. Nemoto, R. Hamaguchi, M. Sato, A. Fujita, T. Imaizumi, and S. Hikosaka, "Building change detection via a combination of CNNs using only RGB aerial imageries," in Remote Sensing Technologies and Applications in Urban Environments II, 2017, vol. 10431: SPIE, pp. 107-118. [DOI:10.1117/12.2277912]
7. S. Ji, Y. Shen, M. Lu, and Y. Zhang, "Building instance change detection from large-scale aerial images using convolutional neural networks and simulated samples," Remote Sensing, vol. 11, no. 11, p. 1343, 2019. [DOI:10.3390/rs11111343]
8. R. Liu, M. Kuffer, and C. Persello, "The temporal dynamics of slums employing a CNN-based change detection approach," Remote Sensing, vol. 11, no. 23, p. 2844, 2019. [DOI:10.3390/rs11232844]
9. R. C. Daudt, B. Le Saux, A. Boulch, and Y. Gousseau, "Urban change detection for multispectral earth observation using convolutional neural networks," in IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, 2018: Ieee, pp. 2115-2118. [DOI:10.1109/IGARSS.2018.8518015]
10. F. Rahman, B. Vasu, J. Van Cor, J. Kerekes, and A. Savakis, "Siamese network with multi-level features for patch-based change detection in satellite imagery," in 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2018: IEEE, pp. 958-962. [DOI:10.1109/GlobalSIP.2018.8646512]
11. M. Wang, K. Tan, X. Jia, X. Wang, and Y. Chen, "A deep siamese network with hybrid convolutional feature extraction module for change detection based on multi-sensor remote sensing images," Remote Sensing, vol. 12, no. 2, p. 205, 2020. [DOI:10.3390/rs12020205]
12. H. Chen and Z. Shi, "A spatial-temporal attention-based method and a new dataset for remote sensing image change detection," Remote Sensing, vol. 12, no. 10, p. 1662, 2020. [DOI:10.3390/rs12101662]
13. P. P. De Bem, O. A. de Carvalho Junior, R. Fontes Guimarães, and R. A. Trancoso Gomes, "Change detection of deforestation in the Brazilian Amazon using landsat data and convolutional neural networks," Remote Sensing, vol. 12, no. 6, p. 901, 2020. [DOI:10.3390/rs12060901]
14. J. Chen et al., "DASNet: Dual attentive fully convolutional Siamese networks for change detection in high-resolution satellite images," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 1194-1206, 2020. [DOI:10.1109/JSTARS.2020.3037893]
15. M. Zhang, G. Xu, K. Chen, M. Yan, and X. Sun, "Triplet-based semantic relation learning for aerial remote sensing image change detection," IEEE Geoscience and Remote Sensing Letters, vol. 16, no. 2, pp. 266-270, 2018. [DOI:10.1109/LGRS.2018.2869608]
16. X. Peng, R. Zhong, Z. Li, and Q. Li, "Optical remote sensing image change detection based on attention mechanism and image difference," IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 9, pp. 7296-7307, 2020. [DOI:10.1109/TGRS.2020.3033009]
17. H. Jiang, X. Hu, K. Li, J. Zhang, J. Gong, and M. Zhang, "PGA-SiamNet: Pyramid feature-based attention-guided Siamese network for remote sensing orthoimagery building change detection," Remote Sensing, vol. 12, no. 3, p. 484, 2020. [DOI:10.3390/rs12030484]
18. F. I. Diakogiannis, F. Waldner, and P. Caccetta, "Looking for change? Roll the dice and demand attention," Remote Sensing, vol. 13, no. 18, p. 3707, 2021. [DOI:10.3390/rs13183707]
19. R. C. Daudt, B. Le Saux, and A. Boulch, "Fully convolutional siamese networks for change detection," in 2018 25th IEEE International Conference on Image Processing (ICIP), 2018: IEEE, pp. 4063-4067.
20. M. Lebedev, Y. V. Vizilter, O. Vygolov, V. Knyaz, and A. Y. Rubis, "CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS," International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, vol. 42, no. 2, 2018. [DOI:10.5194/isprs-archives-XLII-2-565-2018]
21. D. Peng, Y. Zhang, and H. Guan, "End-to-end change detection for high resolution satellite images using improved UNet++," Remote Sensing, vol. 11, no. 11, p. 1382, 2019. [DOI:10.3390/rs11111382]
22. T. Bao, C. Fu, T. Fang, and H. Huo, "PPCNET: A combined patch-level and pixel-level end-to-end deep network for high-resolution remote sensing image change detection," IEEE Geoscience and Remote Sensing Letters, vol. 17, no. 10, pp. 1797-1801, 2020. [DOI:10.1109/LGRS.2019.2955309]
23. B. Hou, Q. Liu, H. Wang, and Y. Wang, "From W-Net to CDGAN: Bitemporal change detection via deep learning techniques," IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 3, pp. 1790-1802, 2019. [DOI:10.1109/TGRS.2019.2948659]
24. Y. Zhan, K. Fu, M. Yan, X. Sun, H. Wang, and X. Qiu, "Change detection based on deep siamese convolutional network for optical aerial images," IEEE Geoscience and Remote Sensing Letters, vol. 14, no. 10, pp. 1845-1849, 2017. [DOI:10.1109/LGRS.2017.2738149]
25. B. Fang, L. Pan, and R. Kou, "Dual learning-based siamese framework for change detection using bi-temporal VHR optical remote sensing images," Remote Sensing, vol. 11, no. 11, p. 1292, 2019. [DOI:10.3390/rs11111292]
26. P. F. Alcantarilla, S. Stent, G. Ros, R. Arroyo, and R. Gherardi, "Street-view change detection with deconvolutional networks," Autonomous Robots, vol. 42, no. 7, pp. 1301-1322, 2018. [DOI:10.1007/s10514-018-9734-5]
27. Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, "Unet++: A nested u-net architecture for medical image segmentation," in Deep learning in medical image analysis and multimodal learning for clinical decision support: Springer, 2018, pp. 3-11. [DOI:10.1007/978-3-030-00889-5_1]
28. Y. Liu, C. Pang, Z. Zhan, X. Zhang, and X. Yang, "Building change detection for remote sensing images using a dual-task constrained deep siamese convolutional network model," IEEE Geoscience and Remote Sensing Letters, vol. 18, no. 5, pp. 811-815, 2020. [DOI:10.1109/LGRS.2020.2988032]
29. J. Xu, C. Luo, X. Chen, S. Wei, and Y. Luo, "Remote sensing change detection based on multidirectional adaptive feature fusion and perceptual similarity," Remote Sensing, vol. 13, no. 15, p. 3053, 2021. [DOI:10.3390/rs13153053]
30. W. G. C. Bandara and V. M. Patel, "A transformer-based siamese network for change detection," arXiv preprint arXiv:2201.01293, 2022. [DOI:10.1109/IGARSS46834.2022.9883686]
31. M. Liu, Z. Chai, H. Deng, and R. Liu, "A CNN-transformer Network with Multi-scale Context Aggregation for Fine-grained Cropland Change Detection," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022. [DOI:10.1109/JSTARS.2022.3177235]
32. R. Shao, C. Du, H. Chen, and J. Li, "SUNet: Change Detection for Heterogeneous Remote Sensing Images from Satellite and UAV Using a Dual-Channel Fully Convolution Network," Remote Sensing, vol. 13, no. 18, p. 3750, 2021. [DOI:10.3390/rs13183750]
33. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770-778. [DOI:10.1109/CVPR.2016.90]
34. Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, "A convnet for the 2020s," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 11976-11986. [DOI:10.1109/CVPR52688.2022.01167]
35. S. Fang, K. Li, J. Shao, and Z. Li, "SNUNet-CD: A densely connected Siamese network for change detection of VHR images," IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, 2021. [DOI:10.1109/LGRS.2021.3056416]
36. O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in International Conference on Medical image computing and computer-assisted intervention, 2015: Springer, pp. 234-241. [DOI:10.1007/978-3-319-24574-4_28]
37. R. C. Daudt, B. Le Saux, A. Boulch, and Y. Gousseau, "Multitask learning for large-scale semantic change detection," Computer Vision and Image Understanding, vol. 187, p. 102783, 2019. [DOI:10.1016/j.cviu.2019.07.003]
38. P. Ebel, S. Saha, and X. X. Zhu, "Fusing multi-modal data for supervised change detection," The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 43, pp. 243-249, 2021. [DOI:10.5194/isprs-archives-XLIII-B3-2021-243-2021]
39. N. Gorelick, M. Hancher, M. Dixon, S. Ilyushchenko, D. Thau, and R. Moore, "Google Earth Engine: Planetary-scale geospatial analysis for everyone," Remote sensing of Environment, vol. 202, pp. 18-27, 2017. [DOI:10.1016/j.rse.2017.06.031]
40. F. Warmerdam, "The geospatial data abstraction library," in Open-source approaches in spatial data handling: Springer, 2008, pp. 87-104. [DOI:10.1007/978-3-540-74831-1_5]
41. A. Kiani, F. Farnood Ahmadi, and H. Ebadi, "Correction of training process in object-based image interpretation via knowledge-based system capabilities," Multimedia Tools and Applications, vol. 80, no. 16, pp. 24901-24924, 2021/04/12 2021, doi: 10.1007/s11042-021-10824-0. [DOI:10.1007/s11042-021-10824-0]
Hasanzadeh Y, Kiani A, Farhadi N. Changes detection of remote sensing images using two-stream two-stream deep neural network. JGST 2023; 13 (1) : 5 URL: http://jgst.issgeac.ir/article-1-1147-en.html