HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data

RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data

Abstract

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting models, i.e., models that do not leverage the spatial relationships among the nodes. We propose a all-Multi-Layer Perceptron (all-MLP) time series forecasting architecture called RPMixer. The all-MLP architecture was chosen due to its recent success in time series forecasting benchmarks. Furthermore, our method capitalizes on the ensemble-like behavior of deep neural networks, where each individual block within the network behaves like a base learner in an ensemble model, particularly when identity mapping residual connections are incorporated. By integrating random projection layers into our model, we increase the diversity among the blocks' outputs, thereby improving the overall performance of the network. Extensive experiments conducted on the largest spatial-temporal forecasting benchmark datasets demonstrate that the proposed method outperforms alternative methods, including both spatial-temporal graph models and general forecasting models.

Benchmarks

BenchmarkMethodologyMetrics
time-series-forecasting-on-etth1-336-1RPMixer
MAE: 0.498
MSE: 0.521
traffic-prediction-on-largestRPMixer
CA MAE: 25.07
GBA MAE: 27.77
GLA MAE: 27.87
SD MAE: 25.25

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data | Papers | HyperAI