Stochastic nonlinear time series forecasting using time-delay reservoir computers: performance and universality

Neural Netw. 2014 Jul:55:59-71. doi: 10.1016/j.neunet.2014.03.004. Epub 2014 Mar 21.

Abstract

Reservoir computing is a recently introduced machine learning paradigm that has already shown excellent performances in the processing of empirical data. We study a particular kind of reservoir computers called time-delay reservoirs that are constructed out of the sampling of the solution of a time-delay differential equation and show their good performance in the forecasting of the conditional covariances associated to multivariate discrete-time nonlinear stochastic processes of VEC-GARCH type as well as in the prediction of factual daily market realized volatilities computed with intraday quotes, using as training input daily log-return series of moderate size. We tackle some problems associated to the lack of task-universality for individually operating reservoirs and propose a solution based on the use of parallel arrays of time-delay reservoirs.

Keywords: Echo state networks; Neural computing; Parallel reservoir computing; Realized volatility; Reservoir computing; Time series forecasting; Time-delay reservoir; Universality; VEC-GARCH model; Volatility forecasting.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Artificial Intelligence
  • Computer Communication Networks / instrumentation*
  • Computers
  • Data Interpretation, Statistical
  • Forecasting / methods*
  • Humans
  • Neural Networks, Computer*
  • Nonlinear Dynamics*
  • Stochastic Processes*
  • Time Factors