-
A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts
Authors:
Lucy Harris,
Andrew T. T. McRae,
Matthew Chantry,
Peter D. Dueben,
Tim N. Palmer
Abstract:
Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision c…
▽ More
Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision community to be successful at super-resolution problems, i.e., learning to add fine-scale structure to coarse images. Leinonen et al. (2020) previously applied a GAN to produce ensembles of reconstructed high-resolution atmospheric fields, given coarsened input data. In this paper, we demonstrate this approach can be extended to the more challenging problem of increasing the accuracy and resolution of comparatively low-resolution input from a weather forecasting model, using high-resolution radar measurements as a "ground truth". The neural network must learn to add resolution and structure whilst accounting for non-negligible forecast error. We show that GANs and VAE-GANs can match the statistical properties of state-of-the-art pointwise post-processing methods whilst creating high-resolution, spatially coherent precipitation maps. Our model compares favourably to the best existing downscaling methods in both pixel-wise and pooled CRPS scores, power spectrum information and rank histograms (used to assess calibration). We test our models and show that they perform in a range of scenarios, including heavy rainfall.
△ Less
Submitted 28 July, 2022; v1 submitted 5 April, 2022;
originally announced April 2022.
-
Mixed-precision for Linear Solvers in Global Geophysical Flows
Authors:
Jan Ackmann,
Peter D. Düben,
Tim N. Palmer,
Piotr K. Smolarkiewicz
Abstract:
Semi-implicit time-stepping schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompani…
▽ More
Semi-implicit time-stepping schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompanied with a detailed evaluation of the impact of reduced precision on the solver convergence and the solution quality.
A detailed inquiry into reduced precision requires a model configuration that is meaningful but cheaper to run and easier to evaluate than full atmosphere/ocean models. This study is therefore conducted in the context of a novel semi-implicit shallow-water model on the sphere, purposely designed to mimic numerical intricacies of modern all-scale weather and climate (W&C) models with the numerical stability independent on celerity of all wave motions. The governing algorithm of the shallow-water model is based on the non-oscillatory MPDATA methods for geophysical flows, whereas the resulting elliptic problem employs a strongly preconditioned non-symmetric Krylov-subspace solver GCR, proven in advanced atmospheric applications. The classical longitude/latitude grid is deliberately chosen to retain the stiffness of global W&C models posed in thin spherical shells as well as to better understand the performance of reduced-precision arithmetic in the vicinity of grid singularities. Precision reduction is done on a software level, using an emulator. The reduced-precision experiments are conducted for established dynamical-core test-cases, like the Rossby-Haurwitz wave number 4 and a zonal orographic flow.
The study shows that selected key components of the elliptic solver, most prominently the preconditioning, can be performed at the level of half precision.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows
Authors:
Jan Ackmann,
Peter D. Düben,
Tim N. Palmer,
Piotr K. Smolarkiewicz
Abstract:
It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for,…
▽ More
It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for, as the linear solver ensures that a sufficient, pre-set level of accuracy is reached. The approach does not require prior availability of a conventional preconditioner and is highly flexible regarding complexity and machine learning design choices. Several machine learning methods are used to learn the optimal preconditioner for a shallow-water model with semi-implicit timestepping that is conceptually similar to more complex atmosphere models. The machine-learning preconditioner is competitive with a conventional preconditioner and provides good results even if it is used outside of the dynamical range of the training dataset.
△ Less
Submitted 6 October, 2020;
originally announced October 2020.
-
Neuronal noise as a physical resource for human cognition
Authors:
T. N. Palmer,
M. O'Shea
Abstract:
A new class of energy-efficient digital microprocessor is being developed which is susceptible to thermal noise and consequently operates in probabilistic rather than conventional deterministic mode. Hybrid computing systems which combine probabilistic and deterministic processors can provide robust and efficient tools for computational problems that hitherto would be intractable by conventional d…
▽ More
A new class of energy-efficient digital microprocessor is being developed which is susceptible to thermal noise and consequently operates in probabilistic rather than conventional deterministic mode. Hybrid computing systems which combine probabilistic and deterministic processors can provide robust and efficient tools for computational problems that hitherto would be intractable by conventional deterministic algorithm. These developments suggest a revised perspective on the consequences of ion-channel noise in slender axons, often regarded as a hindrance to neuronal computations. It is proposed that the human brain is such an energy-efficient hybrid computational system whose remarkable characteristics emerge from constructive synergies between probabilistic and deterministic modes of operation. In particular, the capacity for intuition and creative problem solving appears to arise naturally from such a hybrid system. Bearing in mind that physical thermal noise is both pure and available at no cost, our proposal has implications for attempts to emulate the energy-efficient human brain on conventional energy-intensive deterministic supercomputers.
△ Less
Submitted 16 December, 2014;
originally announced December 2014.
