HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Bridging Simplicity and Sophistication using GLinear: A Novel Architecture for Enhanced Time Series Prediction

Syed Tahir Hussain Rizvi; Neel Kanwal; Muddasar Naeem; Alfredo Cuzzocrea; Antonio Coronato

Bridging Simplicity and Sophistication using GLinear: A Novel Architecture for Enhanced Time Series Prediction

Abstract

Time Series Forecasting (TSF) is an important application across many fields. There is a debate about whether Transformers, despite being good at understanding long sequences, struggle with preserving temporal relationships in time series data. Recent research suggests that simpler linear models might outperform or at least provide competitive performance compared to complex Transformer-based models for TSF tasks. In this paper, we propose a novel data-efficient architecture, GLinear, for multivariate TSF that exploits periodic patterns to provide better accuracy. It also provides better prediction accuracy by using a smaller amount of historical data compared to other state-of-the-art linear predictors. Four different datasets (ETTh1, Electricity, Traffic, and Weather) are used to evaluate the performance of the proposed predictor. A performance comparison with state-of-the-art linear architectures (such as NLinear, DLinear, and RLinear) and transformer-based time series predictor (Autoformer) shows that the GLinear, despite being parametrically efficient, significantly outperforms the existing architectures in most cases of multivariate TSF. We hope that the proposed GLinear opens new fronts of research and development of simpler and more sophisticated architectures for data and computationally efficient time-series analysis.

Code Repositories

t-rizvi/GLinear
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
glinear-on-electricityGLinear
MSE : 0.0883
glinear-on-electricity-192GLinear
MSE: 0.1494
glinear-on-electricity-336GLinear
MSE: 0.1651
glinear-on-electricity-96GLinear
MSE: 0.1313
glinear-on-etth1-192GLinear
MSE: 0.4202
glinear-on-etth1-24GLinear
MSE: 0.3142
glinear-on-etth1-24-multivariateGLinear
MSE: 0.3142
glinear-on-etth1-336GLinear
MSE: 0.4915
glinear-on-etth1-48MSE
MSE: 0.3537
glinear-on-etth1-720-multivariateGLinear
MSE : 0.5923
glinear-on-etth1-96GLinear
MSE: 0.3820
glinear-on-trafficGLinear
MSE : 0.3222
glinear-on-traffic-192GLinear
MSE : 0.4056
glinear-on-traffic-336GLinear
MSE : 0.4201
glinear-on-traffic-720GLinear
MSE : 0.4488
glinear-on-traffic-96GLinear
MSE : 0.3875
glinear-on-weatherGLinear
MSE : 0.0716
glinear-on-weather-192GLinear
MSE : 0.1883
glinear-on-weather-720GLinear
MSE : 0.3200
multivariate-time-series-forecasting-on-44GLinear
MSE : 0.0883
multivariate-time-series-forecasting-on-45GLinear
MSE : 0.3222
multivariate-time-series-forecasting-on-46GLinear
MSE: 0.0716
multivariate-time-series-forecasting-on-etth1-8GLinear
MSE : 0.3142

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp