-
Applying ranking techniques for estimating influence of Earth variables on temperature forecast error
Authors:
M. Julia Flores,
Melissa Ruiz-Vásquez,
Ana Bastos,
René Orth
Abstract:
This paper describes how to analyze the influence of Earth system variables on the errors when providing temperature forecasts. The initial framework to get the data has been based on previous research work, which resulted in a very interesting discovery. However, the aforementioned study only worked on individual correlations of the variables with respect to the error. This research work is going…
▽ More
This paper describes how to analyze the influence of Earth system variables on the errors when providing temperature forecasts. The initial framework to get the data has been based on previous research work, which resulted in a very interesting discovery. However, the aforementioned study only worked on individual correlations of the variables with respect to the error. This research work is going to re-use the main ideas but introduce three main novelties: (1) applying a data science approach by a few representative locations; (2) taking advantage of the rankings created by Spearman correlation but enriching them with other metrics looking for a more robust ranking of the variables; (3) evaluation of the methodology by learning random forest models for regression with the distinct experimental variations. The main contribution is the framework that shows how to convert correlations into rankings and combine them into an aggregate ranking. We have carried out experiments on five chosen locations to analyze the behavior of this ranking-based methodology. The results show that the specific performance is dependent on the location and season, which is expected, and that this selection technique works properly with Random Forest models but can also improve simpler regression models such as Bayesian Ridge. This work also contributes with an extensive analysis of the results. We can conclude that this selection based on the top-k ranked variables seems promising for this real problem, and it could also be applied in other domains.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
High-resolution European daily soil moisture derived with machine learning (2003-2020)
Authors:
Sungmin O,
Rene Orth,
Ulrich Weber,
Seon Ki Park
Abstract:
Machine learning (ML) has emerged as a novel tool for generating large-scale land surface data in recent years. ML can learn the relationship between input and target, e.g. meteorological variables and in-situ soil moisture, and then estimate soil moisture across space and time, independently of prior physics-based knowledge. Here we develop a high-resolution (0.1°) daily soil moisture dataset in…
▽ More
Machine learning (ML) has emerged as a novel tool for generating large-scale land surface data in recent years. ML can learn the relationship between input and target, e.g. meteorological variables and in-situ soil moisture, and then estimate soil moisture across space and time, independently of prior physics-based knowledge. Here we develop a high-resolution (0.1°) daily soil moisture dataset in Europe (SoMo.ml-EU) using Long Short-Term Memory trained with in-situ measurements. The resulting dataset covers three vertical layers and the period 2003-2020. Compared to its previous version with a lower spatial resolution (0.25°), it shows a closer agreement with independent in-situ data in terms of temporal variation, demonstrating the enhanced usefulness of in-situ observations when processed jointly with high-resolution meteorological data. Regional comparison with other gridded datasets also demonstrates the ability of SoMo.ml-EU in describing the variability of soil moisture, including drought conditions. As a result, our new dataset will benefit regional studies requiring high-resolution observation-based soil moisture, such as hydrological and agricultural analyses. The SoMo.ml-EU is available at figshare.
△ Less
Submitted 22 May, 2022;
originally announced May 2022.
-
Global soil moisture from in-situ measurements using machine learning -- SoMo.ml
Authors:
Sungmin O,
Rene Orth
Abstract:
While soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture generated from in-situ measurements using machine learning, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolat…
▽ More
While soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture generated from in-situ measurements using machine learning, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolate daily soil moisture dynamics in space and in time, based on in-situ data collected from more than 1,000 stations across the globe. SoMo.ml provides multi-layer soil moisture data (0-10 cm, 10-30 cm, and 30-50 cm) at 0.25° spatial and daily temporal resolution over the period 2000-2019. The performance of the resulting dataset is evaluated through cross validation and inter-comparison with existing soil moisture datasets. SoMo.ml performs especially well in terms of temporal dynamics, making it particularly useful for applications requiring time-varying soil moisture, such as anomaly detection and memory analyses. SoMo.ml complements the existing suite of modelled and satellite-based datasets given its independent and novel derivation, to support large-scale hydrological, meteorological, and ecological analyses.
△ Less
Submitted 5 October, 2020;
originally announced October 2020.
-
The Geometry of Spaceborne Synthetic Aperture Radar
Authors:
P. H. Robert Orth
Abstract:
The paper defines a new coordinate system that was developed in 1977-78 for the world's first digital synthetic aperture radar (SAR) ground processor for images from the Seasat-A satellite. The coordinate system is for the range-Doppler paradigm in the context of a spaceborne platform orbiting a rotating planet. The mathematical expressions for the azimuth FM rate, isodoppler lines, target illumin…
▽ More
The paper defines a new coordinate system that was developed in 1977-78 for the world's first digital synthetic aperture radar (SAR) ground processor for images from the Seasat-A satellite. The coordinate system is for the range-Doppler paradigm in the context of a spaceborne platform orbiting a rotating planet. The mathematical expressions for the azimuth FM rate, isodoppler lines, target illumination trajectories and antenna attitude determination from Doppler centroid measurements are derived. The method for transforming the SAR images from that SAR digital signal processor that used these parametric inputs is also presented. The paper concludes with a report of the measurement of the map accuracy of the resulting images.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
