-
On the Decision Boundaries of Neural Networks: A Tropical Geometry Perspective
Authors:
Motasem Alfarra,
Adel Bibi,
Hasan Hammoud,
Mohamed Gaafar,
Bernard Ghanem
Abstract:
This work tackles the problem of characterizing and understanding the decision boundaries of neural networks with piecewise linear non-linearity activations. We use tropical geometry, a new development in the area of algebraic geometry, to characterize the decision boundaries of a simple network of the form (Affine, ReLU, Affine). Our main finding is that the decision boundaries are a subset of a…
▽ More
This work tackles the problem of characterizing and understanding the decision boundaries of neural networks with piecewise linear non-linearity activations. We use tropical geometry, a new development in the area of algebraic geometry, to characterize the decision boundaries of a simple network of the form (Affine, ReLU, Affine). Our main finding is that the decision boundaries are a subset of a tropical hypersurface, which is intimately related to a polytope formed by the convex hull of two zonotopes. The generators of these zonotopes are functions of the network parameters. This geometric characterization provides new perspectives to three tasks. (i) We propose a new tropical perspective to the lottery ticket hypothesis, where we view the effect of different initializations on the tropical geometric representation of a network's decision boundaries. (ii) Moreover, we propose new tropical based optimization reformulations that directly influence the decision boundaries of the network for the task of network pruning. (iii) At last, we discuss the reformulation of the generation of adversarial attacks in a tropical sense. We demonstrate that one can construct adversaries in a new tropical setting by perturbing a specific set of decision boundaries by perturbing a set of parameters in the network.
△ Less
Submitted 22 August, 2022; v1 submitted 20 February, 2020;
originally announced February 2020.
-
Full-Duplex Relaying with Improper Gaussian Signaling over Nakagami-m Fading Channels
Authors:
Mohamed Gaafar,
Mohammad Galal Khafagy,
Osama Amin,
Rafael F. Schaefer,
Mohamed-Slim Alouini
Abstract:
We study the potential employment of improper Gaussian signaling (IGS) in full-duplex relaying (FDR) with non-negligible residual self-interference (RSI) under Nakagami- m fading. IGS is recently shown to outperform traditional proper Gaussian signaling (PGS) in several interference-limited settings. In this work, IGS is employed as an attempt to alleviate RSI. We use two performance metrics, name…
▽ More
We study the potential employment of improper Gaussian signaling (IGS) in full-duplex relaying (FDR) with non-negligible residual self-interference (RSI) under Nakagami- m fading. IGS is recently shown to outperform traditional proper Gaussian signaling (PGS) in several interference-limited settings. In this work, IGS is employed as an attempt to alleviate RSI. We use two performance metrics, namely, the outage probability and the ergodic rate. First, we provide upper and lower bounds for the system performance in terms of the relay transmit power and circularity coefficient, a measure of the signal impropriety. Then, we numerically optimize the relay signal parameters based only on the channel statistics to improve the system performance. Based on the analysis, IGS allows FDR to operate even with high RSI. The results show that IGS can leverage higher power budgets to enhance the performance, meanwhile it relieves RSI impact via tuning the signal impropriety. Interestingly, one-dimensional optimization of the circularity coefficient, with maximum relay power, offers a similar performance as the joint optimization, which reduces the optimization complexity. From a throughput standpoint, it is shown that IGS-FDR can outperform not only PGS-FDR, but also half-duplex relaying with/without maximum ratio combining over certain regions of the target source rate.
△ Less
Submitted 26 September, 2017; v1 submitted 21 April, 2017;
originally announced April 2017.
-
Improper Signaling for Virtual Full-Duplex Relay Systems
Authors:
Mohamed Gaafar,
Osama Amin,
Rafael F. Schaefer,
Mohamed-Slim Alouini
Abstract:
Virtual full-duplex (VFD) is a powerful solution to compensate the rate loss of half-duplex relaying without the need to full-duplex capable nodes. Inter-relay interference (IRI) challenges the operation of VFD relaying systems. Recently, improper signaling is employed at both relays of the VFD to mitigate the IRI by imposing the same signal characteristics for both relays. To further boost the ac…
▽ More
Virtual full-duplex (VFD) is a powerful solution to compensate the rate loss of half-duplex relaying without the need to full-duplex capable nodes. Inter-relay interference (IRI) challenges the operation of VFD relaying systems. Recently, improper signaling is employed at both relays of the VFD to mitigate the IRI by imposing the same signal characteristics for both relays. To further boost the achievable rate performance, asymmetric time sharing VFD relaying system is adopted with different improper signals at the half-duplex relays. The joint tuning of the three design parameters improves the achievable rate performance at different ranges of IRI and different relays locations. Extensive simulation results are presented and analyzed to show the achievable rate gain of the proposed system and understand the system behavior.
△ Less
Submitted 14 February, 2017;
originally announced February 2017.
-
Improper Signaling in Two-Path Relay Channels
Authors:
Mohamed Gaafar,
Osama Amin,
Rafael F. Schaefer,
Mohamed-Slim Alouini
Abstract:
Inter-relay interference (IRI) challenges the operation of two-path relaying systems. Furthermore, the unavailability of the channel state information (CSI) at the source and the limited detection capabilities at the relays prevent neither eliminating the interference nor adopting joint detection at the relays nodes. Improper signaling is a powerful signaling scheme that has the capability to redu…
▽ More
Inter-relay interference (IRI) challenges the operation of two-path relaying systems. Furthermore, the unavailability of the channel state information (CSI) at the source and the limited detection capabilities at the relays prevent neither eliminating the interference nor adopting joint detection at the relays nodes. Improper signaling is a powerful signaling scheme that has the capability to reduce the interference impact at the receiver side and improves the achievable rate performance. Therefore, improper signaling is adopted at both relays, which have access to the global CSI. Then, improper signal characteristics are designed to maximize the total end-to-end achievable rate at the relays. To this end, both the power and the circularity coefficient, a measure of the impropriety degree of the signal, are optimized at the relays. Although the optimization problem is not convex, optimal power allocation for both relays for a fixed circularity coefficient is obtained. Moreover, the circularity coefficient is tuned to maximize the rate for a given power allocation. Finally, a joint solution of the optimization problem is proposed using a coordinate descent method based on alternate optimization. The simulation results show that employing improper signaling improves the achievable rate at medium and high IRI.
△ Less
Submitted 7 March, 2017; v1 submitted 17 December, 2016;
originally announced December 2016.
-
Petroleum Refinery Multi-Antenna Propagation Measurements
Authors:
Mohamed Gaafar,
Geoffrey G Messier
Abstract:
This paper presents the results of the first multi- antenna propagation measurement campaign to be conducted at an operating petroleum refining facility. The measurement equipment transmits pseudo-random noise test signals from two antennas at a 2.47 GHz carrier with a signal bandwidth of approximately 25 MHz. The measurement data is analyzed to extract path loss exponent, shadowing distribution,…
▽ More
This paper presents the results of the first multi- antenna propagation measurement campaign to be conducted at an operating petroleum refining facility. The measurement equipment transmits pseudo-random noise test signals from two antennas at a 2.47 GHz carrier with a signal bandwidth of approximately 25 MHz. The measurement data is analyzed to extract path loss exponent, shadowing distribution, fading distribution, coherence bandwidth and antenna correlation. The results reveal an environment where large scale attenuation is relatively mild, fading is severe and good performance is expected from both antenna and frequency diversity.
△ Less
Submitted 1 November, 2016;
originally announced November 2016.
-
Improper Gaussian Signaling in Full-Duplex Relay Channels with Residual Self-Interference
Authors:
Mohamed Gaafar,
Mohammad Galal Khafagy,
Osama Amin,
Mohamed-Slim Alouini
Abstract:
We study the potential employment of improper Gaussian signaling (IGS) in full-duplex cooperative settings with residual self-interference (RSI). IGS is recently shown to outperform traditional proper Gaussian signaling (PGS) in several interference-limited channel settings. In this work, IGS is employed in an attempt to alleviate the RSI adverse effect in full-duplex relaying (FDR). To this end,…
▽ More
We study the potential employment of improper Gaussian signaling (IGS) in full-duplex cooperative settings with residual self-interference (RSI). IGS is recently shown to outperform traditional proper Gaussian signaling (PGS) in several interference-limited channel settings. In this work, IGS is employed in an attempt to alleviate the RSI adverse effect in full-duplex relaying (FDR). To this end, we derive a tight upper bound expression for the end-to-end outage probability in terms of the relay signal parameters represented in its power and circularity coefficient. We further show that the derived upper bound is either monotonic or unimodal in the relay's circularity coefficient. This result allows for easily locating the global optimal point using known numerical methods. Based on the analysis, IGS allows FDR systems to operate even with high RSI. It is shown that, while the communication totally fails with PGS as the RSI increases, the IGS outage probability approaches a fixed value that depends on the channel statistics and target rate. The obtained results show that IGS can leverage higher relay power budgets than PGS to improve the performance, meanwhile it relieves its RSI impact via tuning the signal impropriety.
△ Less
Submitted 2 March, 2016; v1 submitted 4 January, 2016;
originally announced January 2016.
-
Underlay Spectrum Sharing Techniques with In-band Full-Duplex Systems using Improper Gaussian Signaling
Authors:
Mohamed Gaafar,
Osama Amin,
Walid Abediseid,
Mohamed-Slim Alouini
Abstract:
Sharing the spectrum with in-band full-duplex (FD) primary users (PU) is a challenging and interesting problem in the underlay cognitive radio (CR) systems. The self-interference introduced at the primary network may dramatically impede the secondary user (SU) opportunity to access the spectrum. To tackle this problem, we use the so-called improper Gaussian signaling. Particularly, we assume a sys…
▽ More
Sharing the spectrum with in-band full-duplex (FD) primary users (PU) is a challenging and interesting problem in the underlay cognitive radio (CR) systems. The self-interference introduced at the primary network may dramatically impede the secondary user (SU) opportunity to access the spectrum. To tackle this problem, we use the so-called improper Gaussian signaling. Particularly, we assume a system with a SU pair working in a half-duplex mode that uses improper Gaussian signaling while the FD PU pair implements the regular proper Gaussian signaling. First, we derive a closed form expression and an upper bound for the SU and PU outage probabilities, respectively. Second, we optimize the SU signal parameters to minimize its outage probability while maintaining the required PU quality-of-service based on the average channel state information (CSI). Moreover, we provide the conditions to reap merits from employing improper Gaussian signaling at the SU. Third, we design the SU signal parameters based on perfect knowledge of its direct link instantaneous CSI and investigate all benefits that can be achieved at both the SU and PU. Finally, we provide some numerical results that demonstrate the advantages of using improper Gaussian signaling to access the spectrum of the FD PU.
△ Less
Submitted 3 January, 2016;
originally announced January 2016.
-
Sharing the Licensed Spectrum of Full-Duplex Systems using Improper Gaussian Signaling
Authors:
Mohamed Gaafar,
Osama Amin,
Walid Abediseid,
Mohamed-Slim Alouini
Abstract:
Sharing the spectrum with in-band full-duplex (FD) primary users (PU) is a challenging and interesting problem in the underlay cognitive radio (CR) systems. The self-interference introduced at the primary network may dramatically impede the secondary user (SU) opportunity to access the spectrum. In this work, we attempt to tackle this problem through the use of the so-called improper Gaussian sign…
▽ More
Sharing the spectrum with in-band full-duplex (FD) primary users (PU) is a challenging and interesting problem in the underlay cognitive radio (CR) systems. The self-interference introduced at the primary network may dramatically impede the secondary user (SU) opportunity to access the spectrum. In this work, we attempt to tackle this problem through the use of the so-called improper Gaussian signaling. Such a signaling technique has demonstrated its superiority in improving the overall performance in interference limited networks. Particularly, we assume a system with a SU pair working in half-duplex mode that uses improper Gaussian signaling while the FD PU pair implements the regular proper Gaussian signaling techniques. First, we derive a closed form expression for the SU outage probability and an upper bound for the PU outage probability. Then, we optimize the SU signal parameters to minimize its outage probability while maintaining the required PU quality-of-service based on the average channel state information. Finally, we provide some numerical results that validate the tightness of the PU outage probability bound and demonstrate the advantage of employing the improper Gaussian signaling to the SU in order to access the spectrum of the FD PU.
△ Less
Submitted 10 October, 2015;
originally announced October 2015.
-
Spectrum Sharing Opportunities of Full-Duplex Systems using Improper Gaussian Signaling
Authors:
Mohamed Gaafar,
Osama Amin,
Walid Abediseid,
Mohamed-Slim Alouini
Abstract:
Sharing the licensed spectrum of full-duplex (FD) primary users (PU) brings strict limitations on the underlay cognitive radio operation. Particularly, the self interference may overwhelm the PU receiver and limit the opportunity of secondary users (SU) to access the spectrum. Improper Gaussian signaling (IGS) has demonstrated its superiority in improving the performance of interference channel sy…
▽ More
Sharing the licensed spectrum of full-duplex (FD) primary users (PU) brings strict limitations on the underlay cognitive radio operation. Particularly, the self interference may overwhelm the PU receiver and limit the opportunity of secondary users (SU) to access the spectrum. Improper Gaussian signaling (IGS) has demonstrated its superiority in improving the performance of interference channel systems. Throughout this paper, we assume a FD PU pair that uses proper Gaussian signaling (PGS), and a half-duplex SU pair that uses IGS. The objective is to maximize the SU instantaneous achievable rate while meeting the PU quality-of-service. To this end, we propose a simplified algorithm that optimizes the SU signal parameters, i.e, the transmit power and the circularity coefficient, which is a measure of the degree of impropriety of the SU signal, to achieve the design objective. Numerical results show the merits of adopting IGS compared with PGS for the SU especially with the existence of week PU direct channels and/or strong SU interference channels.
△ Less
Submitted 10 October, 2015;
originally announced October 2015.