-
Self-supervised Learning of Dense Hierarchical Representations for Medical Image Segmentation
Authors:
Eytan Kats,
Jochen G. Hirsch,
Mattias P. Heinrich
Abstract:
This paper demonstrates a self-supervised framework for learning voxel-wise coarse-to-fine representations tailored for dense downstream tasks. Our approach stems from the observation that existing methods for hierarchical representation learning tend to prioritize global features over local features due to inherent architectural bias. To address this challenge, we devise a training strategy that…
▽ More
This paper demonstrates a self-supervised framework for learning voxel-wise coarse-to-fine representations tailored for dense downstream tasks. Our approach stems from the observation that existing methods for hierarchical representation learning tend to prioritize global features over local features due to inherent architectural bias. To address this challenge, we devise a training strategy that balances the contributions of features from multiple scales, ensuring that the learned representations capture both coarse and fine-grained details. Our strategy incorporates 3-fold improvements: (1) local data augmentations, (2) a hierarchically balanced architecture, and (3) a hybrid contrastive-restorative loss function. We evaluate our method on CT and MRI data and demonstrate that our new approach particularly beneficial for fine-tuning with limited annotated data and consistently outperforms the baseline counterpart in linear evaluation settings.
△ Less
Submitted 26 May, 2024; v1 submitted 12 January, 2024;
originally announced January 2024.
-
An Uncertainty-Aware, Shareable and Transparent Neural Network Architecture for Brain-Age Modeling
Authors:
Tim Hahn,
Jan Ernsting,
Nils R. Winter,
Vincent Holstein,
Ramona Leenings,
Marie Beisemann,
Lukas Fisch,
Kelvin Sarink,
Daniel Emden,
Nils Opel,
Ronny Redlich,
Jonathan Repple,
Dominik Grotegerd,
Susanne Meinert,
Jochen G. Hirsch,
Thoralf Niendorf,
Beate Endemann,
Fabian Bamberg,
Thomas Kröncke,
Robin Bülow,
Henry Völzke,
Oyunbileg von Stackelberg,
Ramona Felizitas Sowade,
Lale Umutlu,
Börge Schmidt
, et al. (9 additional authors not shown)
Abstract:
The deviation between chronological age and age predicted from neuroimaging data has been identified as a sensitive risk-marker of cross-disorder brain changes, growing into a cornerstone of biological age-research. However, Machine Learning models underlying the field do not consider uncertainty, thereby confounding results with training data density and variability. Also, existing models are com…
▽ More
The deviation between chronological age and age predicted from neuroimaging data has been identified as a sensitive risk-marker of cross-disorder brain changes, growing into a cornerstone of biological age-research. However, Machine Learning models underlying the field do not consider uncertainty, thereby confounding results with training data density and variability. Also, existing models are commonly based on homogeneous training sets, often not independently validated, and cannot be shared due to data protection issues. Here, we introduce an uncertainty-aware, shareable, and transparent Monte-Carlo Dropout Composite-Quantile-Regression (MCCQR) Neural Network trained on N=10,691 datasets from the German National Cohort. The MCCQR model provides robust, distribution-free uncertainty quantification in high-dimensional neuroimaging data, achieving lower error rates compared to existing models across ten recruitment centers and in three independent validation samples (N=4,004). In two examples, we demonstrate that it prevents spurious associations and increases power to detect accelerated brain-aging. We make the pre-trained model publicly available.
△ Less
Submitted 16 July, 2021;
originally announced July 2021.
-
Predicting brain-age from raw T 1 -weighted Magnetic Resonance Imaging data using 3D Convolutional Neural Networks
Authors:
Lukas Fisch,
Jan Ernsting,
Nils R. Winter,
Vincent Holstein,
Ramona Leenings,
Marie Beisemann,
Kelvin Sarink,
Daniel Emden,
Nils Opel,
Ronny Redlich,
Jonathan Repple,
Dominik Grotegerd,
Susanne Meinert,
Niklas Wulms,
Heike Minnerup,
Jochen G. Hirsch,
Thoralf Niendorf,
Beate Endemann,
Fabian Bamberg,
Thomas Kröncke,
Annette Peters,
Robin Bülow,
Henry Völzke,
Oyunbileg von Stackelberg,
Ramona Felizitas Sowade
, et al. (11 additional authors not shown)
Abstract:
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to…
▽ More
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to be sensitive to preprocessing parameters. Here we describe a 3D Convolutional Neural Network (CNN) based on the ResNet architecture being trained on raw, non-registered T$_ 1$-weighted MRI data of N=10,691 samples from the German National Cohort and additionally applied and validated in N=2,173 samples from three independent studies using transfer learning. For comparison, state-of-the-art models using preprocessed neuroimaging data are trained and validated on the same samples. The 3D CNN using raw neuroimaging data predicts age with a mean average deviation of 2.84 years, outperforming the state-of-the-art brain-age models using preprocessed data. Since our approach is invariant to preprocessing software and parameter choices, it enables faster, more robust and more accurate brain-age modeling.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
Algorithmic measurement procedures
Authors:
Aldo F. G. Solis-Labastida,
Jorge G. Hirsch
Abstract:
Measurements are shown to be processes designed to return figures: they are effective. This effectivity allows for a formalization as Turing machines, which can be described employing computation theory. Inspired in the halting problem we draw some limitations for measurement procedures: procedures that verify if a quantity is measured cannot work in every case.
Measurements are shown to be processes designed to return figures: they are effective. This effectivity allows for a formalization as Turing machines, which can be described employing computation theory. Inspired in the halting problem we draw some limitations for measurement procedures: procedures that verify if a quantity is measured cannot work in every case.
△ Less
Submitted 18 June, 2019;
originally announced June 2019.
-
Testing Randomness in Quantum Mechanics
Authors:
Aldo C. Martínez,
Aldo Solís,
Rafael Díaz Hernández Rojas,
Alfred B. U'Ren,
Jorge G. Hirsch,
Isaac Pérez Castillo
Abstract:
Pseudo-random number generators are widely used in many branches of science, mainly in applications related to Monte Carlo methods, although they are deterministic in design and, therefore, unsuitable for tackling fundamental problems in security and cryptography. The natural laws of the microscopic realm provide a fairly simple method to generate non-deterministic sequences of random numbers, bas…
▽ More
Pseudo-random number generators are widely used in many branches of science, mainly in applications related to Monte Carlo methods, although they are deterministic in design and, therefore, unsuitable for tackling fundamental problems in security and cryptography. The natural laws of the microscopic realm provide a fairly simple method to generate non-deterministic sequences of random numbers, based on measurements of quantum states. In practice, however, the experimental devices on which quantum random number generators are based are often unable to pass some tests of randomness. In this review, we briefly discuss two such tests, point out the challenges that we have encountered and finally present a fairly simple method that successfully generates non-deterministic maximally random sequences.
△ Less
Submitted 19 October, 2018;
originally announced October 2018.
