Stationarity and stability of autoregressive neural network processes


We analyze the asymptotic behavior of autoregressive neural network (AR-NN) processes using techniques from Markov chains and non-linear time series analysis. It is shown that standard AR-NNs without shortcut connections are asymptotically stationary. If linear shortcut connections are allowed, only the shortcut weights determine whether the overall system is stationary, hence standard conditions for linear AR processes can be used.

In Proceedings of Advances in Neural Information Processing Systems 1999
Adrian Trapletti
Adrian Trapletti

Quant, software engineer, and consultant mostly investment industry. Long-term contributor and package author R Project for Statistical Computing.