-
Variational Information Bottleneck Model for Accurate Indoor Position Recognition
Authors:
Weizhu Qian,
Franck Gechter
Abstract:
Recognizing user location with WiFi fingerprints is a popular approach for accurate indoor positioning problems. In this work, our goal is to interpret WiFi fingerprints into actual user locations. However, WiFi fingerprint data can be very high dimensional in some cases, we need to find a good representation of the input data for the learning task first. Otherwise, using neural networks will suff…
▽ More
Recognizing user location with WiFi fingerprints is a popular approach for accurate indoor positioning problems. In this work, our goal is to interpret WiFi fingerprints into actual user locations. However, WiFi fingerprint data can be very high dimensional in some cases, we need to find a good representation of the input data for the learning task first. Otherwise, using neural networks will suffer from severe overfitting. In this work, we solve this issue by combining the Information Bottleneck method and Variational Inference. Based on these two approaches, we propose a Variational Information Bottleneck model for accurate indoor positioning. The proposed model consists of an encoder structure and a predictor structure. The encoder is to find a good representation in the input data for the learning task. The predictor is to use the latent representation to predict the final output. To enhance the generalization of our model, we also adopt the Dropout technique for each hidden layer of the decoder. We conduct the validation experiments on a real-world dataset. We also compare the proposed model to other existing methods so as to quantify the performances of our method.
△ Less
Submitted 26 January, 2021;
originally announced January 2021.
-
Multi-Task Variational Information Bottleneck
Authors:
Weizhu Qian,
Bowei Chen,
Yichao Zhang,
Guanghui Wen,
Franck Gechter
Abstract:
Multi-task learning (MTL) is an important subject in machine learning and artificial intelligence. Its applications to computer vision, signal processing, and speech recognition are ubiquitous. Although this subject has attracted considerable attention recently, the performance and robustness of the existing models to different tasks have not been well balanced. This article proposes an MTL model…
▽ More
Multi-task learning (MTL) is an important subject in machine learning and artificial intelligence. Its applications to computer vision, signal processing, and speech recognition are ubiquitous. Although this subject has attracted considerable attention recently, the performance and robustness of the existing models to different tasks have not been well balanced. This article proposes an MTL model based on the architecture of the variational information bottleneck (VIB), which can provide a more effective latent representation of the input features for the downstream tasks. Extensive observations on three public data sets under adversarial attacks show that the proposed model is competitive to the state-of-the-art algorithms concerning the prediction accuracy. Experimental results suggest that combining the VIB and the task-dependent uncertainties is a very effective way to abstract valid information from the input features for accomplishing multiple tasks.
△ Less
Submitted 1 March, 2021; v1 submitted 1 July, 2020;
originally announced July 2020.
-
Supervised and Semi-supervised Deep Probabilistic Models for Indoor Positioning Problems
Authors:
Weizhu Qian,
Fabrice Lauri,
Franck Gechter
Abstract:
Predicting smartphone users location with WiFi fingerprints has been a popular research topic recently. In this work, we propose two novel deep learning-based models, the convolutional mixture density recurrent neural network and the VAE-based semi-supervised learning model. The convolutional mixture density recurrent neural network is designed for path prediction, in which the advantages of convo…
▽ More
Predicting smartphone users location with WiFi fingerprints has been a popular research topic recently. In this work, we propose two novel deep learning-based models, the convolutional mixture density recurrent neural network and the VAE-based semi-supervised learning model. The convolutional mixture density recurrent neural network is designed for path prediction, in which the advantages of convolutional neural networks, recurrent neural networks and mixture density networks are combined. Further, since most of real-world datasets are not labeled, we devise the VAE-based model for the semi-supervised learning tasks. In order to test the proposed models, we conduct the validation experiments on the real-world datasets. The final results verify the effectiveness of our approaches and show the superiority over other existing methods.
△ Less
Submitted 16 March, 2021; v1 submitted 22 November, 2019;
originally announced November 2019.
-
A Probabilistic Approach for Discovering Daily Human Mobility Patterns with Mobile Data
Authors:
Weizhu Qian,
Fabrice Lauri,
Franck Gechter
Abstract:
Discovering human mobility patterns with geo-location data collected from smartphone users has been a hot research topic in recent years. In this paper, we attempt to discover daily mobile patterns based on GPS data. We view this problem from a probabilistic perspective in order to explore more information from the original GPS data compared to other conventional methods. A non-parameter Bayesian…
▽ More
Discovering human mobility patterns with geo-location data collected from smartphone users has been a hot research topic in recent years. In this paper, we attempt to discover daily mobile patterns based on GPS data. We view this problem from a probabilistic perspective in order to explore more information from the original GPS data compared to other conventional methods. A non-parameter Bayesian modeling method, Infinite Gaussian Mixture Model, is used to estimate the probability density for the daily mobility. Then, we use Kullback-Leibler divergence as the metrics to measure the similarity of different probability distributions. And combining Infinite Gaussian Mixture Model and Kullback-Leibler divergence, we derived an automatic clustering algorithm to discover mobility patterns for each individual user without setting the number of clusters in advance. In the experiments, the effectiveness of our method is validated on the real user data collected from different users. The results show that the IGMM-based algorithm outperforms the GMM-based algorithm. We also test our methods on the dataset with different lengths to discover the minimum data length for discovering mobility patterns.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
Convolutional Mixture Density Recurrent Neural Network for Predicting User Location with WiFi Fingerprints
Authors:
Weizhu Qian,
Fabrice Lauri,
Franck Gechter
Abstract:
Predicting smartphone users activity using WiFi fingerprints has been a popular approach for indoor positioning in recent years. However, such a high dimensional time-series prediction problem can be very tricky to solve. To address this issue, we propose a novel deep learning model, the convolutional mixture density recurrent neural network (CMDRNN), which combines the strengths of convolutional…
▽ More
Predicting smartphone users activity using WiFi fingerprints has been a popular approach for indoor positioning in recent years. However, such a high dimensional time-series prediction problem can be very tricky to solve. To address this issue, we propose a novel deep learning model, the convolutional mixture density recurrent neural network (CMDRNN), which combines the strengths of convolutional neural networks, recurrent neural networks and mixture density networks. In our model, the CNN sub-model is employed to detect the feature of the high dimensional input, the RNN sub-model is utilized to capture the time dependency and the MDN sub-model is for predicting the final output. For validation, we conduct the experiments on the real-world dataset and the obtained results illustrate the effectiveness of our method.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
Towards a Theory for Bio - Cyber Physical Systems Modelling
Authors:
Didier Fass,
Franck Gechter
Abstract:
Currently, CyberPhysical Systems (CPS) represents a great challenge for automatic control and smart systems engineering on both theoretical and practical levels. Designing CPS requires approaches involving multidisciplinary competences. However they are designed to be autonomous, the CPS present a part of uncertainty, which requires interaction with human for engineering, monitoring, controlling,…
▽ More
Currently, CyberPhysical Systems (CPS) represents a great challenge for automatic control and smart systems engineering on both theoretical and practical levels. Designing CPS requires approaches involving multidisciplinary competences. However they are designed to be autonomous, the CPS present a part of uncertainty, which requires interaction with human for engineering, monitoring, controlling, performing operational maintenance, etc. This human-CPS interaction led naturally to the human in-the-loop (HITL) concept. Nevertheless, this HITL concept , which stems from a reductionist point of view, exhibits limitations due to the different natures of the systems involved. As opposed to this classical approach, we propose, in this paper, a model of Bio-CPS (i.e. systems based on an integration of computational elements within biological systems) grounded on theoretical biology, physics and computer sciences and based on the key concept of human systems integration.
△ Less
Submitted 26 January, 2016;
originally announced January 2016.