-
Controllable and Gradual Facial Blemishes Retouching via Physics-Based Modelling
Authors:
Chenhao Shuai,
Rizhao Cai,
Bandara Dissanayake,
Amanda Newman,
Dayan Guan,
Dennis Sng,
Ling Li,
Alex Kot
Abstract:
Face retouching aims to remove facial blemishes, such as pigmentation and acne, and still retain fine-grain texture details. Nevertheless, existing methods just remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and ance. Mo…
▽ More
Face retouching aims to remove facial blemishes, such as pigmentation and acne, and still retain fine-grain texture details. Nevertheless, existing methods just remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and ance. Motivated by this limitation, we propose our Controllable and Gradual Face Retouching (CGFR). Our CGFR is based on physical modelling, adopting Sum-of-Gaussians to approximate skin subsurface scattering in a decomposed melanin and haemoglobin color space. Our CGFR offers a user-friendly control over the facial blemishes, achieving realistic and gradual blemishes retouching. Experimental results based on actual clinical data shows that CGFR can realistically simulate the blemishes' gradual recovering process.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Evaluating the Efficacy of Skincare Product: A Realistic Short-Term Facial Pore Simulation
Authors:
Ling Li,
Bandara Dissanayake,
Tatsuya Omotezako,
Yunjie Zhong,
Qing Zhang,
Rizhao Cai,
Qian Zheng,
Dennis Sng,
Weisi Lin,
Yufei Wang,
Alex C Kot
Abstract:
Simulating the effects of skincare products on face is a potential new way to communicate the efficacy of skincare products in skin diagnostics and product recommendations. Furthermore, such simulations enable one to anticipate his/her skin conditions and better manage skin health. However, there is a lack of effective simulations today. In this paper, we propose the first simulation model to reve…
▽ More
Simulating the effects of skincare products on face is a potential new way to communicate the efficacy of skincare products in skin diagnostics and product recommendations. Furthermore, such simulations enable one to anticipate his/her skin conditions and better manage skin health. However, there is a lack of effective simulations today. In this paper, we propose the first simulation model to reveal facial pore changes after using skincare products. Our simulation pipeline consists of 2 steps: training data establishment and facial pore simulation. To establish training data, we collect face images with various pore quality indexes from short-term (8-weeks) clinical studies. People often experience significant skin fluctuations (due to natural rhythms, external stressors, etc.,), which introduces large perturbations in clinical data. To address this problem, we propose a sliding window mechanism to clean data and select representative index(es) to represent facial pore changes. Facial pore simulation stage consists of 3 modules: UNet-based segmentation module to localize facial pores; regression module to predict time-dependent warping hyperparameters; and deformation module, taking warping hyperparameters and pore segmentation labels as inputs, to precisely deform pores accordingly. The proposed simulation is able to render realistic facial pore changes. And this work will pave the way for future research in facial skin simulation and skincare product developments.
△ Less
Submitted 23 February, 2023;
originally announced February 2023.
-
A Systematic Approach for MRI Brain Tumor Localization, and Segmentation using Deep Learning and Active Contouring
Authors:
Shanaka Ramesh Gunasekara,
H. N. T. K. Kaldera,
Maheshi B. Dissanayake
Abstract:
One of the main requirements of tumor extraction is the annotation and segmentation of tumor boundaries correctly. For this purpose, we present a threefold deep learning architecture. First classifiers are implemented with a deep convolutional neural network(CNN) andsecond a region-based convolutional neural network (R-CNN) is performed on the classified images to localize the tumor regions of int…
▽ More
One of the main requirements of tumor extraction is the annotation and segmentation of tumor boundaries correctly. For this purpose, we present a threefold deep learning architecture. First classifiers are implemented with a deep convolutional neural network(CNN) andsecond a region-based convolutional neural network (R-CNN) is performed on the classified images to localize the tumor regions of interest. As the third and final stage, the concentratedtumor boundary is contoured for the segmentation process by using the Chan-Vesesegmentation algorithm. As the typical edge detection algorithms based on gradients of pixel intensity tend to fail in the medical image segmentation process, an active contour algorithm defined with the level set function is proposed. Specifically, Chan- Vese algorithm was applied to detect the tumor boundaries for the segmentation process. To evaluate the performance of the overall system, Dice Score,Rand Index (RI), Variation of Information (VOI), Global Consistency Error (GCE), Boundary Displacement Error (BDE), Mean absolute error (MAE), and Peak Signal to Noise Ratio (PSNR) werecalculated by comparing the segmented boundary area which is the final output of the proposed, against the demarcations of the subject specialists which is the gold standard. Overall performance of the proposed architecture for both glioma and meningioma segmentation is with average dice score of 0.92, (also, with RI of 0.9936, VOI of 0.0301, GCE of 0.004, BDE of 2.099, PSNR of 77.076 and MAE of 52.946), pointing to high reliability of the proposed architecture.
△ Less
Submitted 6 February, 2021;
originally announced February 2021.
-
Deep Learning Methods for Screening Pulmonary Tuberculosis Using Chest X-rays
Authors:
Chirath Dasanayakaa,
Maheshi Buddhinee Dissanayake
Abstract:
Tuberculosis (TB) is a contagious bacterial airborne disease, and is one of the top 10 causes of death worldwide. According to the World Health Organization (WHO), around 1.8 billion people are infected with TB and 1.6 million deaths were reported in 2018. More importantly,95% of cases and deaths were from developing countries. Yet, TB is a completely curable disease through early diagnosis. To ac…
▽ More
Tuberculosis (TB) is a contagious bacterial airborne disease, and is one of the top 10 causes of death worldwide. According to the World Health Organization (WHO), around 1.8 billion people are infected with TB and 1.6 million deaths were reported in 2018. More importantly,95% of cases and deaths were from developing countries. Yet, TB is a completely curable disease through early diagnosis. To achieve this goal one of the key requirements is efficient utilization of existing diagnostic technologies, among which chest X-ray is the first line of diagnostic tool used for screening for active TB. The presented deep learning pipeline consists of three different state of the art deep learning architectures, to generate, segment and classify lung X-rays. Apart from this image preprocessing, image augmentation, genetic algorithm based hyper parameter tuning and model ensembling were used to to improve the diagnostic process. We were able to achieve classification accuracy of 97.1% (Youden's index-0.941,sensitivity of 97.9% and specificity of 96.2%) which is a considerable improvement compared to the existing work in the literature. In our work, we present an highly accurate, automated TB screening system using chest X-rays, which would be helpful especially for low income countries with low access to qualified medical professionals.
△ Less
Submitted 25 December, 2020;
originally announced December 2020.
-
A Feasibility study for Deep learning based automated brain tumor segmentation using Magnetic Resonance Images
Authors:
Shanaka Ramesh Gunasekara,
HNTK Kaldera,
Maheshi B. Dissanayake
Abstract:
Deep learning algorithms have accounted for the rapid acceleration of research in artificial intelligence in medical image analysis, interpretation, and segmentation with many potential applications across various sub disciplines in medicine. However, only limited number of research which investigates these application scenarios, are deployed into the clinical sector for the evaluation of the real…
▽ More
Deep learning algorithms have accounted for the rapid acceleration of research in artificial intelligence in medical image analysis, interpretation, and segmentation with many potential applications across various sub disciplines in medicine. However, only limited number of research which investigates these application scenarios, are deployed into the clinical sector for the evaluation of the real requirement and the practical challenges of the model deployment. In this research, a deep convolutional neural network (CNN) based classification network and Faster RCNN based localization network were developed for brain tumor MR image classification and tumor localization. A typical edge detection algorithm called Prewitt was used for tumor segmentation task, based on the output of the tumor localization. Overall performance of the proposed tumor segmentation architecture, was analyzed using objective quality parameters including Accuracy, Boundary Displacement Error (BDE), Dice score and confidence interval. A subjective quality assessment of the model was conducted based on the Double Stimulus Impairment Scale (DSIS) protocol using the input of medical expertise. It was observed that the confidence level of our segmented output was in a similar range to that of experts. Also, the Neurologists have rated the output of our model as highly accurate segmentation.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
Sylvester Matrix Based Similarity Estimation Method for Automation of Defect Detection in Textile Fabrics
Authors:
R. M. L. N. Kumari,
G. A. C. T. Bandara,
Maheshi B. Dissanayake
Abstract:
Fabric defect detection is a crucial quality control step in the textile manufacturing industry. In this article, machine vision system based on the Sylvester Matrix Based Similarity Method (SMBSM) is proposed to automate the defect detection process. The algorithm involves six phases, namely resolution matching, image enhancement using Histogram Specification and Median-Mean Based Sub-Image-Clipp…
▽ More
Fabric defect detection is a crucial quality control step in the textile manufacturing industry. In this article, machine vision system based on the Sylvester Matrix Based Similarity Method (SMBSM) is proposed to automate the defect detection process. The algorithm involves six phases, namely resolution matching, image enhancement using Histogram Specification and Median-Mean Based Sub-Image-Clipped Histogram Equalization, image registration through alignment and hysteresis process, image subtraction, edge detection, and fault detection by means of the rank of the Sylvester matrix. The experimental results demonstrate that the proposed method is robust and yields an accuracy of 93.4%, precision of 95.8%, with 2275 ms computational speed.
△ Less
Submitted 8 December, 2020;
originally announced December 2020.
-
Damage Detection in Bridge Structures: An Edge Computing Approach
Authors:
Rahul Kumar Verma,
K. K. Pattanaik,
P. B. R. Dissanayake,
A. J. Dammika,
H. A. D. Samith Buddika,
Mosbeh R. Kaloop
Abstract:
Wireless sensor network (WSN) based SHM systems have shown significant improvement as compared to traditional wired-SHM systems in terms of cost, accuracy, and reliability of the monitoring. However, due to the resource-constrained nature of the sensor nodes, it is a challenge to process a large amount of sensed vibration data in real-time. Existing mechanisms of data processing are centralized an…
▽ More
Wireless sensor network (WSN) based SHM systems have shown significant improvement as compared to traditional wired-SHM systems in terms of cost, accuracy, and reliability of the monitoring. However, due to the resource-constrained nature of the sensor nodes, it is a challenge to process a large amount of sensed vibration data in real-time. Existing mechanisms of data processing are centralized and use cloud or remote servers to analyze the data to characterize the state of the bridge, i.e., healthy or damaged. These methods are feasible for wired-SHM systems, however, transmitting huge data-sets in WSNs has been found to be arduous. In this paper, we propose a mechanism named as ``in-network damage detection on edge (INDDE)" which extracts the statistical features from raw acceleration measurements corresponding to the healthy condition of the bridge and use them to train a probabilistic model, i.e., estimating the probability density function (PDF) of multivariate Gaussian distribution. The trained model helps to identify the anomalous behaviour of the new data points collected from the unknown condition of the bridge in real-time. Each edge device classifies the condition of the bridge as either "healthy" or "damaged" around its deployment region depending on their respective trained model. Experimentation results showcase a promising 96-100% damage detection accuracy with the advantage of no data transmission from sensor nodes to the cloud for processing.
△ Less
Submitted 15 August, 2020;
originally announced August 2020.