-
SDF2Net: Shallow to Deep Feature Fusion Network for PolSAR Image Classification
Authors:
Mohammed Q. Alkhatib,
M. Sami Zitouni,
Mina Al-Saad,
Nour Aburaed,
Hussain Al-Ahmad
Abstract:
Polarimetric synthetic aperture radar (PolSAR) images encompass valuable information that can facilitate extensive land cover interpretation and generate diverse output products. Extracting meaningful features from PolSAR data poses challenges distinct from those encountered in optical imagery. Deep learning (DL) methods offer effective solutions for overcoming these challenges in PolSAR feature e…
▽ More
Polarimetric synthetic aperture radar (PolSAR) images encompass valuable information that can facilitate extensive land cover interpretation and generate diverse output products. Extracting meaningful features from PolSAR data poses challenges distinct from those encountered in optical imagery. Deep learning (DL) methods offer effective solutions for overcoming these challenges in PolSAR feature extraction. Convolutional neural networks (CNNs) play a crucial role in capturing PolSAR image characteristics by leveraging kernel capabilities to consider local information and the complex-valued nature of PolSAR data. In this study, a novel three-branch fusion of complex-valued CNN, named the Shallow to Deep Feature Fusion Network (SDF2Net), is proposed for PolSAR image classification. To validate the performance of the proposed method, classification results are compared against multiple state-of-the-art approaches using the airborne synthetic aperture radar (AIRSAR) datasets of Flevoland and San Francisco, as well as the ESAR Oberpfaffenhofen dataset. The results indicate that the proposed approach demonstrates improvements in overallaccuracy, with a 1.3% and 0.8% enhancement for the AIRSAR datasets and a 0.5% improvement for the ESAR dataset. Analyses conducted on the Flevoland data underscore the effectiveness of the SDF2Net model, revealing a promising overall accuracy of 96.01% even with only a 1% sampling ratio.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
Attention based Dual-Branch Complex Feature Fusion Network for Hyperspectral Image Classification
Authors:
Mohammed Q. Alkhatib,
Mina Al-Saad,
Nour Aburaed,
M. Sami Zitouni,
Hussain Al Ahmad
Abstract:
This research work presents a novel dual-branch model for hyperspectral image classification that combines two streams: one for processing standard hyperspectral patches using Real-Valued Neural Network (RVNN) and the other for processing their corresponding Fourier transforms using Complex-Valued Neural Network (CVNN). The proposed model is evaluated on the Pavia University and Salinas datasets.…
▽ More
This research work presents a novel dual-branch model for hyperspectral image classification that combines two streams: one for processing standard hyperspectral patches using Real-Valued Neural Network (RVNN) and the other for processing their corresponding Fourier transforms using Complex-Valued Neural Network (CVNN). The proposed model is evaluated on the Pavia University and Salinas datasets. Results show that the proposed model outperforms state-of-the-art methods in terms of overall accuracy, average accuracy, and Kappa. Through the incorporation of Fourier transforms in the second stream, the model is able to extract frequency information, which complements the spatial information extracted by the first stream. The combination of these two streams improves the overall performance of the model. Furthermore, to enhance the model performance, the Squeeze and Excitation (SE) mechanism has been utilized. Experimental evidence show that SE block improves the models overall accuracy by almost 1\%.
△ Less
Submitted 2 November, 2023;
originally announced November 2023.
-
Linear and Circular Microphone Array for Remote Surveillance: Simulated Performance Analysis
Authors:
Abdulla AlShehhi,
M. Luai Hammadih,
M. Sami Zitouni,
Saif AlKindi,
Nazar Ali,
Luis Weruaga
Abstract:
Acoustic beamforming with a microphone array represents an adequate technology for remote acoustic surveillance, as the system has no mechanical parts and it has moderate size. However, in order to accomplish real implementation, several challenges need to be addressed, such as array geometry, microphone characteristics, and the digital beamforming algorithms. This paper presents a simulated analy…
▽ More
Acoustic beamforming with a microphone array represents an adequate technology for remote acoustic surveillance, as the system has no mechanical parts and it has moderate size. However, in order to accomplish real implementation, several challenges need to be addressed, such as array geometry, microphone characteristics, and the digital beamforming algorithms. This paper presents a simulated analysis on the effect of the array geometry in the beamforming response. Two geometries are considered, namely, the linear and the circular geometry. The analysis is performed with computer simulations to mimic reality. The future steps comprise the construction of the physical microphone array, and the software implementation on a multichannel digital signal processing (DSP) system.
△ Less
Submitted 7 March, 2017;
originally announced March 2017.
-
On the Role and the Importance of Features for Background Modeling and Foreground Detection
Authors:
Thierry Bouwmans,
Caroline Silva,
Cristina Marghes,
Mohammed Sami Zitouni,
Harish Bhaskar,
Carl Frelicot
Abstract:
Background modeling has emerged as a popular foreground detection technique for various applications in video surveillance. Background modeling methods have become increasing efficient in robustly modeling the background and hence detecting moving objects in any visual scene. Although several background subtraction and foreground detection have been proposed recently, no traditional algorithm toda…
▽ More
Background modeling has emerged as a popular foreground detection technique for various applications in video surveillance. Background modeling methods have become increasing efficient in robustly modeling the background and hence detecting moving objects in any visual scene. Although several background subtraction and foreground detection have been proposed recently, no traditional algorithm today still seem to be able to simultaneously address all the key challenges of illumination variation, dynamic camera motion, cluttered background and occlusion. This limitation can be attributed to the lack of systematic investigation concerning the role and importance of features within background modeling and foreground detection. With the availability of a rather large set of invariant features, the challenge is in determining the best combination of features that would improve accuracy and robustness in detection. The purpose of this study is to initiate a rigorous and comprehensive survey of features used within background modeling and foreground detection. Further, this paper presents a systematic experimental and statistical analysis of techniques that provide valuable insight on the trends in background modeling and use it to draw meaningful recommendations for practitioners. In this paper, a preliminary review of the key characteristics of features based on the types and sizes is provided in addition to investigating their intrinsic spectral, spatial and temporal properties. Furthermore, improvements using statistical and fuzzy tools are examined and techniques based on multiple features are benchmarked against reliability and selection criterion. Finally, a description of the different resources available such as datasets and codes is provided.
△ Less
Submitted 28 November, 2016;
originally announced November 2016.