Search

Hundreds of petabytes are produced annually at weather and climate forecast centres worldwide. Compression is essential to reduce storage and to facilitate data sharing. Current techniques do not distinguish the real from the false information in data, leaving the level of meaningful precision unassessed or often subjectively chosen. Many of the trailing mantissa bits in floating-point numbers occur independently with high information entropy, reducing the efficiency of compression algorithms. Here we define the bitwise real information content from information theory as the mutual information of bits in adjacent grid points. The analysis automatically determines a precision from the data itself, based on the separation of real and false information bits. Applied to data from the Copernicus Atmospheric Monitoring Service (CAMS), most variables contain fewer than 7 bits of real information per value and are highly compressible due to spatio-temporal correlation. Rounding bits without real information to zero facilitates lossless compression algorithms and encodes the uncertainty within the data itself. The removal of bits with high entropy but low real information allows us to minimize information loss but maximize the efficiency of the compression algorithms. All CAMS data are 17x compressed in the longitudinal dimension and relative to 64-bit floats, while preserving 99% of real information. Combined with four-dimensional compression using the floating-point compressor Zfp, factors beyond 60x are achieved, with no significant increase of the forecast error. For multidimensional compression it is generally advantageous to include as many highly correlated dimensions as possible. A data compression Turing test is proposed to optimize compressibility while minimizing information loss for the end use of weather and climate forecast data.

As part of the Copernicus Atmosphere Monitoring Service (CAMS), operated by ECMWF on behalf of the European Commission, global analyses and forecasts of atmospheric composition have been produced operationally since 2015. These were built on many years of previous work under the GEMS and MACC projects, which began producing regular forecasts in 2007.Since the transition to an operational service, there have continued to be many new developments and improvements to the system in five major upgrades, including increased horizontal and vertical resolution, updated emissions and paramterisations, additional species such as nitrate aerosol, as well as updates to the underlying meteorological model and data assimilation. The components of this system (aerosols, gas-phase chemistry, meteorology and the ocean) are also now coupled more tightly via active feedbacks then ever before.In this interactive presentation, we will demonstrate the impact of a number of these developments on the performance of the resulting global air quality forecasts, alongside the continuing evolution of our approaches to assessing model improvement against independent in-situ and remote-sensing observations from a variety of platforms.Because the continuing evolution of an operational system can make the analysis of long-term trends problematic, we will also contrast this with the CAMS global reanalysis product, which (while not using the very latest version of the model) do provide a consistent long-term dataset from 2003 onwards.

A portable Fourier transform spectrometer (FTS), model EM27/SUN, was deployed onboard the research vessel Polarstern to measure the column-average dry air mole fractions of carbon dioxide (XCO2) and methane (XCH4) by means of direct sunlight absorption spectrometry. We report on technical developments as well as data calibration and reduction measures required to achieve the targeted accuracy of fractions of a percent in retrieved XCO2 and XCH4 while operating the instrument under field conditions onboard the moving platform during a 6-week cruise on the Atlantic from Cape Town (South Africa, 34° S, 18° E; 5 March 2014) to Bremerhaven (Germany, 54° N, 19° E; 14 April 2014). We demonstrate that our solar tracker typically achieved a tracking precision of better than 0.05° toward the center of the sun throughout the ship cruise which facilitates accurate XCO2 and XCH4 retrievals even under harsh ambient wind conditions. We define several quality filters that screen spectra, e.g., when the field of view was partially obstructed by ship structures or when the lines-of-sight crossed the ship exhaust plume. The measurements in clean oceanic air, can be used to characterize a spurious air-mass dependency. After the campaign, deployment of the spectrometer alongside the TCCON (Total Carbon Column Observing Network) instrument at Karlsruhe, Germany, allowed for determining a calibration factor that makes the entire campaign record traceable to World Meteorological Organization (WMO) standards. Comparisons to observations of the GOSAT satellite and concentration fields modeled by the European Centre for Medium-Range Weather Forecasts (ECMWF) Copernicus Atmosphere Monitoring Service (CAMS) demonstrate that the observational setup is well suited to provide validation opportunities above the ocean and along interhemispheric transects.

The Global Fire Assimilation System (GFASv1.0) calculates biomass burning emissions by assimilating Fire Radiative Power (FRP) observations from the MODIS instruments onboard the Terra and Aqua satellites. It corrects for gaps in the observations, which are mostly due to cloud cover, and filters spurious FRP observations of volcanoes, gas flares and other industrial activity. The combustion rate is subsequently calculated with land cover-specific conversion factors. Emission factors for 40 gas-phase and aerosol trace species have been compiled from a literature survey. The corresponding daily emissions have been calculated on a global 0.5° × 0.5° grid from 2003 to the present. General consistency with the Global Fire Emission Database version 3.1 (GFED3.1) within its accuracy is achieved while maintaining the advantages of an FRP-based approach: GFASv1.0 makes use of the quantitative information on the combustion rate that is contained in the FRP observations, and it detects fires in real time at high spatial and temporal resolution. GFASv1.0 indicates omission errors in GFED3.1 due to undetected small fires. It also exhibits slightly longer fire seasons in South America and North Africa and a slightly shorter fire season in Southeast Asia. GFASv1.0 has already been used for atmospheric reactive gas simulations in an independent study, which found good agreement with atmospheric observations. We have performed simulations of the atmospheric aerosol distribution with and without the assimilation of MODIS aerosol optical depth (AOD). They indicate that the emissions of particulate matter need to be boosted by a factor of 2–4 to reproduce the global distribution of organic matter and black carbon. This discrepancy is also evident in the comparison of previously published top-down and bottom-up estimates. For the time being, a global enhancement of the particulate matter emissions by 3.4 is recommended. Validation with independent AOD and PM10 observations recorded during the Russian fires in summer 2010 show that the global Monitoring Atmospheric Composition and Change (MACC) aerosol model with GFASv1.0 aerosol emissions captures the smoke plume evolution well when organic matter and black carbon are enhanced by the recommended factor. In conjunction with the assimilation of MODIS AOD, the use of GFASv1.0 with enhanced emission factors quantitatively improves the forecast of the aerosol load near the surface sufficiently to allow air quality warnings with a lead time of up to four days.

Aerosols affect the atmosphere through the aerosol-radiation and the aerosol-clouds interactions. In this paper we report on a new mechanism whereby the radiative effect of dust aerosol on surface fluxes acts to increase the dust loading of the atmosphere via modification of boundary-layer stability, thereby acting to enhance the radiative aerosol effect. This positive feedback between dust aerosol and boundary layer stability occurred during a series of dust storms in the Sahara and the Eastern Mediterranean in April 2012, which were studied using the Monitoring Atmospheric Composition and Climate – Interim Implementation (MACC-II) system. The radiative fluxes in the shortwave and long-wave spectra were both significantly affected by the prognostic aerosols-radiation interation, which strongly influenced the meteorological simulation. Reduced incoming solar radiation below the aerosol layers caused a decrease in maximum surface temperatures, and consequently a more stable thermal stratification of the lower atmosphere. The increased thermal stability led to decreased surface wind speeds and therefore to smaller amounts of dust aerosol emissions. Larger downwelling long-wave fluxes were associated with the opposite processes: less stable thermal stratification at night, brought mainly by higher minimum temperatures at the surface, caused stronger surface winds. Overall, the impact by the long-wave radiative forcing was more important than the short-wave contribution. This feedback was amplified when taken into account in the aerosol analysis of the MACC-II global system. It lead to a notable improvement in short term forecast of short and long-wave radiative fluxes, of surface temperature but also of the aerosol burden itself. Forecasts of radiative fluxes in the shortwave and long-wave spectrum were also improved. At a longer range the improvement were less important as the forecast error of the aerosol load increased, thereby highlighting the importance of accurate aerosol representation in the study of aerosol-radiation interaction.