SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecasting

22 Aug 2023  ·  Shengsheng Lin, Weiwei Lin, Wentai Wu, Feiyu Zhao, Ruichao Mo, Haotong Zhang ·

RNN-based methods have faced challenges in the Long-term Time Series Forecasting (LTSF) domain when dealing with excessively long look-back windows and forecast horizons. Consequently, the dominance in this domain has shifted towards Transformer, MLP, and CNN approaches. The substantial number of recurrent iterations are the fundamental reasons behind the limitations of RNNs in LTSF. To address these issues, we propose two novel strategies to reduce the number of iterations in RNNs for LTSF tasks: Segment-wise Iterations and Parallel Multi-step Forecasting (PMF). RNNs that combine these strategies, namely SegRNN, significantly reduce the required recurrent iterations for LTSF, resulting in notable improvements in forecast accuracy and inference speed. Extensive experiments demonstrate that SegRNN not only outperforms SOTA Transformer-based models but also reduces runtime and memory usage by more than 78%. These achievements provide strong evidence that RNNs continue to excel in LTSF tasks and encourage further exploration of this domain with more RNN-based approaches. The source code is coming soon.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Time Series Forecasting ETTh1 (192) Multivariate SegRNN MSE 0.385 # 3
MAE 0.402 # 6
Time Series Forecasting ETTh1 (192) Univariate SegRNN MSE 0.068 # 2
MAE 0.208 # 2
Time Series Forecasting ETTh1 (336) Multivariate SegRNN MSE 0.401 # 2
MAE 0.417 # 10
Time Series Forecasting ETTh1 (336) Univariate SegRNN MSE 0.073 # 1
MAE 0.215 # 10
Time Series Forecasting ETTh1 (720) Multivariate SegRNN MSE 0.434 # 1
MAE 0.447 # 11
Time Series Forecasting ETTh1 (720) Univariate SegRNN MSE 0.085 # 3
MAE 0.233 # 10
Time Series Forecasting ETTh1 (96) Multivariate SegRNN MSE 0.341 # 1
MAE 0.376 # 5
Time Series Forecasting ETTh1 (96) Univariate SegRNN MSE 0.053 # 1
MAE 0.18 # 2
Time Series Forecasting ETTh2 (192) Multivariate SegRNN MSE 0.321 # 2
MAE 0.36 # 6
Time Series Forecasting ETTh2 (192) Univariate SegRNN MSE 0.158 # 2
MAE 0.317 # 5
Time Series Forecasting ETTh2 (336) Multivariate SegRNN MSE 0.325 # 2
MAE 0.374 # 10
Time Series Forecasting ETTh2 (336) Univariate SegRNN MSE 0.18 # 5
MAE 0.345 # 6
Time Series Forecasting ETTh2 (720) Multivariate SegRNN MSE 0.394 # 3
MAE 0.424 # 10
Time Series Forecasting ETTh2 (720) Univariate SegRNN MSE 0.205 # 3
MAE 0.365 # 3
Time Series Forecasting ETTh2 (96) Multivariate SegRNN MSE 0.263 # 2
MAE 0.32 # 6
Time Series Forecasting ETTh2 (96) Univariate SegRNN MSE 0.121 # 2
MAE 0.272 # 4
Time Series Forecasting Weather (192) SegRNN MSE 0.186 # 1
MAE 0.227 # 1
Time Series Forecasting Weather (336) SegRNN MSE 0.237 # 1
MAE 0.269 # 1
Time Series Forecasting Weather (720) SegRNN MSE 0.31 # 1
MAE 0.32 # 1
Time Series Forecasting Weather (96) SegRNN MSE 0.142 # 1
MAE 0.181 # 1

Methods