Search

Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. To fill the dearth of resources covering neural networks with a meteorological lens, this paper discusses machine learning methods in a plain language format that is targeted to the operational meteorological community. This is the second paper in a pair that aim to serve as a machine learning resource for meteorologists. While the first paper focused on traditional machine learning methods (e.g., random forest), here a broad spectrum of neural networks and deep learning methods is discussed. Specifically, this paper covers perceptrons, artificial neural networks, convolutional neural networks, and U-networks. Like the Part I paper, this manuscript discusses the terms associated with neural networks and their training. Then the manuscript provides some intuition behind every method and concludes by showing each method used in a meteorological example of diagnosing thunderstorms from satellite images (e.g., lightning flashes). This paper is accompanied with an open-source code repository to allow readers to explore neural networks using either the dataset provided (which is used in the paper) or as a template for alternate datasets. [ABSTRACT FROM AUTHOR]

The Cyclone Global Navigation Satellite System (CYGNSS) mission has generated several new ocean surface data products. Because of its high overpass rate and ability to measure surface wind speeds through weather, these data products are typically higher temporal resolution than traditional satellite tropical cyclone (TC) data products. However, the nature of the Global Navigation Satellite Systems reflectometry (GNSS-R) signal, which is essentially a single pixelwide measurement along the CYGNSS specular point (SP) track on the ground, necessitates aggregating the wind speed data over a period of time to accurately characterize TCs in terms of intensity and structure. The standard CYGNSS level 3 (L3) wind products are averaged over 1 h, which typically is not sufficient to produce an accurate characterization. A new L3 storm-centric gridded (SCG) wind speed product is presented here. It has been developed to improve upon the standard L3 algorithm for the purpose of providing better characterization of TC wind fields over their storm life cycle. This paper describes the L3 SCG algorithm, provides examples of L3 SCG wind fields, and discusses the potential uses and limitations of the new data product. [ABSTRACT FROM AUTHOR]

There are many sources of uncertainty in satellite precipitation retrievals of warm rain. In this paper, the second of a two-part study, we focus on uncertainties related to spatial heterogeneity and surface clutter. A cloud-resolving model simulation of warm, shallow clouds is used to simulate satellite observations from three theoretical satellite architectures—one similar to the Global Precipitation Measurement Core Observatory, one similar to CloudSat, and one similar to the planned Atmosphere Observing System (AOS). Rain rates are then retrieved using a common optimal estimation framework. For this case, retrieval biases due to nonuniform beamfilling are very large, with retrieved rain rates negatively (low) biased by as much as 40%–50% (depending on satellite architecture) at 5 km horizontal resolution. Surface clutter also acts to negatively bias retrieved rain rates. Combining all sources of uncertainty, the theoretical AOS satellite is found to outperform CloudSat in terms of retrieved surface rain rate, with a bias of −19% as compared with −28%, a reduced spread of retrieval errors, and an additional 17.5% of cases falling within desired uncertainty limits. The results speak to the need for additional high-resolution modeling simulations of warm rain so as to better characterize the uncertainties in satellite precipitation retrievals. [ABSTRACT FROM AUTHOR]

Sea surface temperature (SST) fronts are important for fisheries and marine ecology, as well as upper-ocean dynamics, weather forecasting, and climate monitoring. In this paper, we propose a new approach to detect SST fronts from RADARSAT-2 ScanSAR images, based on the correlation of SAR-derived wind speeds using the gray level cooccurrence matrix (GLCM) approach. Due to the large differences between the correlation of wind speeds for SST fronts compared to other areas, SST fronts can be detected by the threshold method. To eliminate small-scale features (or noise), the 30 km scale is used as the length threshold for the detection of the SST fronts. The proposed method is effective when wind speeds are between 3 and 13 m s−1. The overall accuracy of our method is about 93.6%, which is sufficient for operational applications. [ABSTRACT FROM AUTHOR]

Two spaceborne radars currently in orbit enable the sampling of snowfall near the surface and throughout the atmospheric column, namely, CloudSat's Cloud Profiling Radar (CPR) and the Global Precipitation Measurement mission's Dual-Frequency Precipitation Radar (GPM-DPR). In this paper, a direct comparison of the CPR's 2C-SNOW-PROFILE (2CSP), the operational GPM-DPR algorithm (2ADPR) and a neural network (NN) retrieval applied to the GPM-DPR data is performed using coincident observations between both radars. Examination of over 3500 profiles within moderate to strong precipitation (Ka band ≥ 18 dBZ) show that the NN retrieval provides the closest retrieval of liquid equivalent precipitation rate R immediately above the melting level to the R retrieved just below the melting layer, agreeing within 5%. Meanwhile, 2CSP retrieves a maximum value of R at −15°C, decreases by 35% just above the melting layer, and is about 50% smaller than the GPM-DPR retrieved R below the melting layer. CPR-measured reflectivity shows median reduction of 2–3 dB from −15° to −2.5°C, likely the reason for the 2CSP retrieval reduction of R. Two case studies from NASA field campaigns [i.e., Olympic Mountains Experiment (OLYMPEX) and Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS)] provide analogs to the type of precipitating systems found in the comparison between retrieval products. For the snowfall events that GPM-DPR can observe, this work suggests that the 2CSP retrieval is likely underestimating the unattenuated reflectivity, resulting in a potential negative, or low, bias in R. Future work should investigate how frequently the underestimated reflectivity profiles occur within the CPR record and quantify its potential effects on global snowfall accumulation estimation. [ABSTRACT FROM AUTHOR]

A robust and computationally efficient object tracking algorithm is developed by incorporating various tracking techniques. Physical properties of the objects, such as brightness temperature or reflectivity, are not considered. Therefore, the algorithm is adaptable for tracking convection-like features in simulated data and remotely sensed two-dimensional images. In this algorithm, a first guess of the motion, estimated using the Fourier phase shift, is used to predict the candidates for matching. A disparity score is computed for each target–candidate pair. The disparity also incorporates overlapping criteria in the case of large objects. Then the Hungarian method is applied to identify the best pairs by minimizing the global disparity. The high-disparity pairs are unmatched, and their target and candidate are declared expired and newly initiated objects, respectively. They are tested for merger and split on the basis of their size and overlap with the other objects. The sensitivity of track duration is shown for different disparity and size thresholds. The paper highlights the algorithm's ability to study convective life cycles using radar and simulated data over Darwin, Australia. The algorithm skillfully tracks individual convective cells (a few pixels in size) and large convective systems. The duration of tracks and cell size are found to be lognormally distributed over Darwin. The evolution of size and precipitation types of isolated convective cells is presented in the Lagrangian perspective. This algorithm is part of a vision for a modular platform [viz., TINT is not TITAN (TINT) and Tracking and Object-Based Analysis of Clouds (tobac)] that will evolve into a sustainable choice to analyze atmospheric features. [ABSTRACT FROM AUTHOR]

The Dual-Frequency Precipitation Radar (DPR) on board the Global Precipitation Measurement (GPM) mission core satellite provides the new-generation global observation of rain since 2014. The main objective of this paper is to evaluate the suitability and limitation of GPM-DPR level-2 products over China. The DPR rain rate products are compared with rain gauge data during the summers of 5 years (2014-18). The ground observation network is composed of more than 50 000 rain gauges. The DPR precipitation products for all scans (DPR_NS, DPR_MS, and DPR_HS) generally underestimate rain rates. However, DPR_MS agrees better with gauge estimates thanDPR_NS and DPR_HS, yielding the lowest mean error, systematic deviation, and highest Pearson correlation coefficient. In addition, all three swath types show obvious overestimation over gauge estimates between 0.5 and 1mmh-1 and underestimation when gauge estimates are larger than 1mmh-1. The DPR_HS and DPR_MS agree better with gauge estimates below and above 2.5mmh-1, respectively. A deeper investigation was carried out to analyze the variation of DPR_MS's performance with respect to terrains over China. An obvious underestimation, relative to gauge estimates, occurs in Tibetan Plateau while a slight overestimation occurs in the North China Plain. Furthermore, our comprehensive analysis suggests that in Sichuan Basin, the DPR_MS exhibit the best agreement with gauge estimates. [ABSTRACT FROM AUTHOR]

An assumption related to clouds is one of uncertain factors in precipitation retrievals by the Dual-Frequency Precipitation Radar (DPR) on board the Global Precipitation Measurement (GPM) Core Observatory. While an attenuation due to cloud ice is negligibly small for Ku and Ka bands, attenuation by cloud liquid water is larger in the Ka band and estimating precipitation intensity with high accuracy from Ka-band observations can require developing a method to estimate the attenuation due to cloud liquid water content (CLWC). This paper describes a CLWC database used in the DPR level-2 algorithm for the GPM V06A product. In the algorithm, the CLWC value is assumed using the database with inputs of precipitation-related variables, temperature, and geolocation information. A calculation of the database was made using the 3.5-km-mesh global atmospheric simulation derived from the Nonhydrostatic Icosahedral Atmospheric Model (NICAM) global cloud-system-resolving model. Impacts of current CLWC assumptions for surface precipitation estimates were evaluated by comparisons of precipitation retrieval results between default values and 0 mg m−3 of the CLWC. The impacts were quantified by the normalized mean absolute difference (NMAD) and the NMAD values showed 2.3% for the Ku, 9.9% for the Ka, and 6.5% for the dual-frequency algorithms in global averages, while they were larger in the tropics than in high latitudes. Effects of the precipitation estimates from the CLWC assumption were examined further in terms of retrieval processes affected by the CLWC assumption. This study emphasizes the CLWC assumption provided more effects on the precipitation estimates through estimating path-integrated attenuation due to rain. [ABSTRACT FROM AUTHOR]

The scattering of microwaves at frequencies between 50 and 200 GHz by ice particles in the atmosphere is an essential element in the retrieval of instantaneous surface precipitation from spaceborne passive radiometers. This paper explores how the variable distribution of solid and liquid hydrometeors in the atmospheric column over land surfaces affects the brightness temperature (TB) measured by GMI at 89 GHz through the analysis of Dual-Frequency Precipitation Radar (DPR) reflectivity profiles along the 89-GHz beam. The objective is to refine the statistical relations between observed TBs and surface precipitation over land and to define their limits. As GMI is scanning with a 53° Earth incident angle, the observed atmospheric volume is actually not a vertical column, which may lead to very heterogeneous and seemingly inconsistent distributions of the hydrometeors inside the beam. It is found that the 89-GHz TB is mostly sensitive to the presence of ice hydrometeors several kilometers above the 0°C isotherm, up to 10 km above the 0°C isotherm for the deepest convective systems, but is a modest predictor of the surface precipitation rate. To perform a precise mapping of atmospheric ice, the altitude of the individual ice clusters must be known. Indeed, if variations in the altitude of ice are not accounted for, then the high incident angle of GMI causes a horizontal shift (parallax shift) between the estimated position of the ice clusters and their actual position. We show here that the altitude of ice clusters can be derived from the 89-GHz TB itself, allowing for correction of the parallax shift. [ABSTRACT FROM AUTHOR]

The Dual-Frequency Precipitation Radar (DPR) on board the Global Precipitation Measurement (GPM) Core Observatory has reflectivity measurements at two different frequencies: Ku and Ka bands. The dual-frequency ratio from the measurements has been used to perform rain type classification and microphysics retrieval in the current DPR level 2 algorithm. The dual-frequency classification module is a new module in the GPM level 2 algorithm. The module performs rain type classification and melting region detection using the vertical profile of the dual-frequency ratio. This paper presents an evaluation of the performance of the GPM dual-frequency classification module after launch. The evaluation process includes a comparison between the dual-frequency classification results and the TRMM legacy single-frequency results, as well as validation with ground radars. [ABSTRACT FROM AUTHOR]

In this paper, the operational Global Precipitation Measurement (GPM) mission combined radar-radiometer algorithm is thoroughly described. The operational combined algorithm is designed to reduce uncertainties in GPM Core Observatory precipitation estimates by effectively integrating complementary information from the GPM Dual-Frequency Precipitation Radar (DPR) and the GPM Microwave Imager (GMI) into an optimal, physically consistent precipitation product. Although similar in many respects to previously developed combined algorithms, the GPM combined algorithm has several unique features that are specifically designed to meet the GPM objectives of deriving, based on GPM Core Observatory information, accurate and physically consistent precipitation estimates from multiple spaceborne instruments, and ancillary environmental data from reanalyses. The algorithm features an optimal estimation framework based on a statistical formulation of the Gauss-Newton method, a parameterization for the nonuniform distribution of precipitation within the radar fields of view, a methodology to detect and account for multiple scattering in Ka-band DPR observations, and a statistical deconvolution technique that allows for an efficient sequential incorporation of radiometer information into DPR precipitation retrievals. [ABSTRACT FROM AUTHOR]

The Global Precipitation Measurement (GPM) Dual-Frequency Precipitation Radar (DPR) algorithms consist of modules. This paper describes version 4 (V4) of GPM DPR level 2 (L2) classification (CSF) modules, which consist of two single-frequency (SF) modules-that is, Ku-only and Ka-only modules-and a dual-frequency (DF) module. Each CSF module detects bright band (BB) and classifies rain into three major types, that is, stratiform, convective, and other. The Ku-only and Ka-only CSF modules use algorithms that are similar to the Tropical Rainfall Measuring Mission (TRMM) rain type classification algorithm 2A23. The DF CSF module uses a new method called the measured dual-frequency ratio (DFRm) method for the rain type classification and the detection of BB. It is shown that the Ku-only CSF module and the DF CSF module produce almost indistinguishable rain type counts in a statistical sense. It is also shown that the DFRm method in the DF CSF module improves the detection of BB. [ABSTRACT FROM AUTHOR]

This paper outlines an approach for estimating latent heating, surface rainfall rate, and liquid water path in warm rain from downward-viewing W-band radar observations using a Bayesian Monte Carlo algorithm. The algorithm utilizes observed vertical and path-integrated characteristics of precipitating liquid clouds to identify the most appropriate hydrometeor and latent heating structures in a large database of profiles generated using a cloud-resolving model. These characteristics are selected by applying multiple performance metrics to synthetic retrievals. Analysis of the retrievals suggests that a combination of cloud-top, rain-top, and maximum reflectivity heights; vertically integrated reflectivity and attenuation; and a measure of near-surface intensity is sufficient to constrain bulk properties and the vertical structure of warm rain systems. When applied to observations at CloudSat resolution, biases in retrieved liquid water path and surface rainfall rate are small (less than 10%). The algorithm also captures the vertical structure of latent heating, although the magnitudes of integrated heating and cooling exhibit nearly compensating low biases. Random errors are larger owing to the limitations of single-frequency radar observations in constraining drop size distributions. Uncertainties in the altitudes of peak heating and cooling at the pixel scale are typically less than one vertical level, while uncertainties in vertically resolved estimates of heating and cooling rates are on the order of a factor of 2. The utility of the technique is illustrated through application to case studies from airborne radar data from the VAMOS Ocean-Cloud-Atmosphere-Land Study field campaign and satellite observations from CloudSat. [ABSTRACT FROM AUTHOR]

This paper demonstrates the impact of the enhancement in detectability by the dual-frequency precipitation radar (DPR) on board the Global Precipitation Measurement (GPM) core observatory. By setting two minimum detectable reflectivities-12 and 18 dB Z-artificially to 6 months of GPM DPR measurements, the precipitation occurrence and volume increase by ~21.1% and ~1.9%, respectively, between 40°S and 40°N. GPM DPR is found to be able to detect light precipitation, which mainly consists of two distinct types. One type is shallow precipitation, which is most significant for convective precipitation over eastern parts of subtropical oceans, where deep convection is typically suppressed. The other type is probably associated with lower parts of anvil clouds associated with organized precipitation systems. While these echoes have lower reflectivities than the official value of the minimum detectable reflectivity, they are found to mostly consist of true precipitation signals, suggesting that the official value may be too conservative for some sort of meteorological analyses. These results are expected to further the understanding of both global energy and water budgets and the diabatic heating distribution. [ABSTRACT FROM AUTHOR]

The Geostationary Operational Environmental Satellite-14 ( GOES-14) Imager operated in 1-min Super Rapid Scan Operations for GOES-R (SRSOR) mode during summer and fall of 2012 to emulate the high temporal resolution sampling of the GOES-R Advanced Baseline Imager (ABI). The current GOES operational scan interval is 15-30 min, which is too coarse to capture details important for severe convective storm forecasting including 1) when indicators of a severe storm such as rapid cloud-top cooling, overshooting tops, and above-anvil cirrus plumes first appear; 2) how satellite-observed cloud tops truly evolve over time; and 3) how satellite cloud-top observations compare with radar and lightning observations at high temporal resolution. In this paper, SRSOR data, radar, and lightning observations are used to analyze five convective storms, four of which were severe, to address these uncertainties. GOES cloud-top cooling, increased lightning flash rates, and peak precipitation echo tops often preceded severe weather, signaling rapid intensification of the storm updraft. Near the time of several severe hail or damaging wind events, GOES cloud-top temperatures and radar echo tops were warming rapidly, which indicated variability in the storm updraft that could have allowed the hail and wind gusts to reach the surface. Above-anvil cirrus plumes were another prominent indicator of impending severe weather. Detailed analysis of storms throughout the 2012 SRSOR period indicates that 57% of the plume-producing storms were severe and 85% of plumes from severe storms appeared before a severe weather report with an average lead time of 18 min, 9 min earlier than what would be observed by GOES operational scanning. [ABSTRACT FROM AUTHOR]

Although satellite precipitation estimates provide valuable information for weather and flood forecasts, infrared (IR) brightness temperature (BT)-based algorithms often produce large errors for precipitation detection and estimation during deep convective systems (DCSs). As DCSs produce greatly varying precipitation rates below similar IR BT retrievals, using IR BTs alone to estimate precipitation in DCSs is problematic. Classifying a DCS into convective-core (CC), stratiform (SR), and anvil cloud (AC) regions allows an evaluation of estimated precipitation distributions among DCS components to supplement typical quantitative precipitation estimate (QPE) evaluations and to diagnose these IR-based algorithm biases. This paper assesses the performance of the National Mosaic and Multi-Sensor Next Generation Quantitative Precipitation Estimation System (NMQ Q2), and a simplified version of the Self-Calibrating Multivariate Precipitation Retrieval (SCaMPR) algorithm, over the state of Oklahoma using Oklahoma Mesonet observations. While average annual Q2 precipitation estimates were about 35% higher than Mesonet observations, strong correlations exist between these two datasets for multiple temporal and spatial scales. Additionally, the Q2-estimated precipitation distribution among DCS components strongly resembled the Mesonet-observed distribution, indicating Q2 can accurately capture the precipitation characteristics of DCSs despite its wet bias. SCaMPR retrievals were typically 3-4 times higher than Mesonet observations, with relatively weak correlations during 2012. Overestimates from SCaMPR retrievals were primarily caused by precipitation retrievals from the anvil regions of DCSs when collocated Mesonet stations recorded no precipitation. A modified SCaMPR retrieval algorithm, employing both cloud optical depth and IR temperature, has the potential to make significant improvements to reduce the wet bias of SCaMPR retrievals over anvil regions of a DCS. [ABSTRACT FROM AUTHOR]

This brief paper addresses the frequency of precipitating open-cell convection over the northeastern Gulf of Alaska during a 5-yr period (2002-06). The research employs 154 previously documented satellite synthetic aperture radar-derived wind speed (SDWS) images that contain open-cell convection signatures. Each SDWS image is paired with a near-in-time, National Weather Service Weather Surveillance Radar-1988 Doppler Level-III 0.5°-elevation-angle short-range base reflectivity image from coastal Alaska for which coverage spatially overlaps open-cell convection signatures. The time difference between any two images of a single pair is typically a few minutes or less. For 65% of the image pairs, at least one SDWS open-cell convection signature in the overlap region is associated with precipitation. That percentage may be conservative given the method used in this research. Thus, the results of this research support a suggestion that has been posed in previous studies that the organization of open-cell convection can be controlled by the interaction of the environmental vertical wind shear and precipitation-driven cold pools. [ABSTRACT FROM AUTHOR]