TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Multivariate Time Series Forecasting	BPI challenge '12	QuerySelector	Accuracy	0.79	# 1
Time Series Forecasting	ETTh1 (168) Multivariate	Transformer	MSE	0.7146	# 3
Time Series Forecasting	ETTh1 (168) Multivariate	Transformer	MAE	0.6325	# 2
Time Series Forecasting	ETTh1 (168) Multivariate	QuerySelector	MSE	0.6835	# 2
Time Series Forecasting	ETTh1 (168) Multivariate	QuerySelector	MAE	0.6088	# 3
Time Series Forecasting	ETTh1 (168) Univariate	QuerySelector	MSE	0.0935	# 2
Time Series Forecasting	ETTh1 (168) Univariate	QuerySelector	MAE	0.2371	# 3
Time Series Forecasting	ETTh1 (168) Univariate	Transformer	MSE	0.1049	# 3
Time Series Forecasting	ETTh1 (168) Univariate	Transformer	MAE	0.2539	# 2
Time Series Forecasting	ETTh1 (24) Multivariate	Transformer	MSE	0.4496	# 3
Time Series Forecasting	ETTh1 (24) Multivariate	Transformer	MAE	0.4788	# 2
Time Series Forecasting	ETTh1 (24) Multivariate	QuerySelector	MSE	0.4226	# 2
Time Series Forecasting	ETTh1 (24) Multivariate	QuerySelector	MAE	0.4627	# 3
Time Series Forecasting	ETTh1 (24) Univariate	Transformer	MSE	0.0548	# 4
Time Series Forecasting	ETTh1 (24) Univariate	Transformer	MAE	0.183	# 1
Time Series Forecasting	ETTh1 (24) Univariate	QuerySelector	MSE	0.0436	# 2
Time Series Forecasting	ETTh1 (24) Univariate	QuerySelector	MAE	0.1616	# 2
Time Series Forecasting	ETTh1 (336) Multivariate	Transformer	MSE	0.8321	# 11
Time Series Forecasting	ETTh1 (336) Multivariate	Transformer	MAE	0.7041	# 2
Time Series Forecasting	ETTh1 (336) Multivariate	QuerySelector	MSE	0.8503	# 12
Time Series Forecasting	ETTh1 (336) Multivariate	QuerySelector	MAE	0.7039	# 3
Time Series Forecasting	ETTh1 (336) Univariate	QuerySelector	MSE	0.1267	# 8
Time Series Forecasting	ETTh1 (336) Univariate	QuerySelector	MAE	0.2844	# 3
Time Series Forecasting	ETTh1 (336) Univariate	Transformer	MSE	0.1541	# 9
Time Series Forecasting	ETTh1 (336) Univariate	Transformer	MAE	0.3201	# 2
Time Series Forecasting	ETTh1 (48) Multivariate	Transformer	MSE	0.4668	# 3
Time Series Forecasting	ETTh1 (48) Multivariate	Transformer	MAE	0.4968	# 2
Time Series Forecasting	ETTh1 (48) Multivariate	QuerySelector	MSE	0.4581	# 2
Time Series Forecasting	ETTh1 (48) Multivariate	QuerySelector	MAE	0.4878	# 3
Time Series Forecasting	ETTh1 (48) Univariate	Transformer	MSE	0.074	# 3
Time Series Forecasting	ETTh1 (48) Univariate	Transformer	MAE	0.2144	# 2
Time Series Forecasting	ETTh1 (48) Univariate	QuerySelector	MSE	0.0721	# 2
Time Series Forecasting	ETTh1 (48) Univariate	QuerySelector	MAE	0.2118	# 3
Time Series Forecasting	ETTh1 (720) Multivariate	QuerySelector	MSE	1.115	# 13
Time Series Forecasting	ETTh1 (720) Multivariate	QuerySelector	MAE	0.8428	# 1
Time Series Forecasting	ETTh1 (720) Multivariate	Transformer	MSE	1.108	# 12
Time Series Forecasting	ETTh1 (720) Multivariate	Transformer	MAE	0.8399	# 2
Time Series Forecasting	ETTh1 (720) Univariate	QuerySelector	MSE	0.2136	# 11
Time Series Forecasting	ETTh1 (720) Univariate	QuerySelector	MAE	0.373	# 2
Time Series Forecasting	ETTh1 (720) Univariate	Transformer	MSE	0.2501	# 12
Time Series Forecasting	ETTh1 (720) Univariate	Transformer	MAE	0.4213	# 1
Time Series Forecasting	ETTh2 (168) Multivariate	Transformer	MSE	1.6225	# 3
Time Series Forecasting	ETTh2 (168) Multivariate	Transformer	MAE	0.9726	# 3
Time Series Forecasting	ETTh2 (168) Multivariate	QuerySelector	MSE	1.7385	# 4
Time Series Forecasting	ETTh2 (168) Multivariate	QuerySelector	MAE	1.0125	# 1
Time Series Forecasting	ETTh2 (168) Univariate	QuerySelector	MSE	0.1753	# 3
Time Series Forecasting	ETTh2 (168) Univariate	QuerySelector	MAE	0.3322	# 2
Time Series Forecasting	ETTh2 (168) Univariate	Transformer	MSE	0.1974	# 4
Time Series Forecasting	ETTh2 (168) Univariate	Transformer	MAE	0.3547	# 1
Time Series Forecasting	ETTh2 (24) Multivariate	QuerySelector	MSE	0.4124	# 2
Time Series Forecasting	ETTh2 (24) Multivariate	QuerySelector	MAE	0.4864	# 3
Time Series Forecasting	ETTh2 (24) Multivariate	Transformer	MSE	0.4237	# 3
Time Series Forecasting	ETTh2 (24) Multivariate	Transformer	MAE	0.5013	# 2
Time Series Forecasting	ETTh2 (24) Univariate	QuerySelector	MSE	0.0843	# 3
Time Series Forecasting	ETTh2 (24) Univariate	QuerySelector	MAE	0.2239	# 2
Time Series Forecasting	ETTh2 (24) Univariate	Transformer	MSE	0.0999	# 4
Time Series Forecasting	ETTh2 (24) Univariate	Transformer	MAE	0.2479	# 1
Time Series Forecasting	ETTh2 (336) Multivariate	Transformer	MSE	2.6617	# 13
Time Series Forecasting	ETTh2 (336) Multivariate	Transformer	MAE	1.2189	# 1
Time Series Forecasting	ETTh2 (336) Multivariate	QuerySelector	MSE	2.3168	# 12
Time Series Forecasting	ETTh2 (336) Multivariate	QuerySelector	MAE	1.1859	# 2
Time Series Forecasting	ETTh2 (336) Univariate	QuerySelector	MSE	0.2088	# 8
Time Series Forecasting	ETTh2 (336) Univariate	QuerySelector	MAE	0.371	# 2
Time Series Forecasting	ETTh2 (336) Univariate	Transformer	MSE	0.2191	# 10
Time Series Forecasting	ETTh2 (336) Univariate	Transformer	MAE	0.3805	# 1
Time Series Forecasting	ETTh2 (48) Multivariate	Transformer	MSE	1.522	# 4
Time Series Forecasting	ETTh2 (48) Multivariate	Transformer	MAE	0.9488	# 1
Time Series Forecasting	ETTh2 (48) Multivariate	QuerySelector	MSE	1.4074	# 3
Time Series Forecasting	ETTh2 (48) Multivariate	QuerySelector	MAE	0.9317	# 2
Time Series Forecasting	ETTh2 (48) Univariate	Transformer	MSE	0.1218	# 4
Time Series Forecasting	ETTh2 (48) Univariate	Transformer	MAE	0.2763	# 1
Time Series Forecasting	ETTh2 (48) Univariate	QuerySelector	MSE	0.1117	# 3
Time Series Forecasting	ETTh2 (48) Univariate	QuerySelector	MAE	0.2622	# 2
Time Series Forecasting	ETTh2 (720) Multivariate	QuerySelector	MSE	3.0664	# 12
Time Series Forecasting	ETTh2 (720) Multivariate	QuerySelector	MAE	1.3084	# 2
Time Series Forecasting	ETTh2 (720) Multivariate	Transformer	MSE	3.1805	# 13
Time Series Forecasting	ETTh2 (720) Multivariate	Transformer	MAE	1.3668	# 1
Time Series Forecasting	ETTh2 (720) Univariate	Transformer	MSE	0.2853	# 10
Time Series Forecasting	ETTh2 (720) Univariate	Transformer	MAE	0.434	# 11
Time Series Forecasting	ETTh2 (720) Univariate	QuerySelector	MSE	0.2585	# 8
Time Series Forecasting	ETTh2 (720) Univariate	QuerySelector	MAE	0.413	# 8
Multivariate Time Series Forecasting	Helpdesk	QuerySelector	Accuracy	0.743	# 1

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/multivariate-time-series-forecasting-on-bpi)](https://paperswithcode.com/sota/multivariate-time-series-forecasting-on-bpi?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/multivariate-time-series-forecasting-on)](https://paperswithcode.com/sota/multivariate-time-series-forecasting-on?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-168-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-168-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-168-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-168-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-24-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-24-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-24-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-24-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-48-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-48-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-48-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-48-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-24-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-24-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-168-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-168-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-168-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-168-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-24-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-24-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-48-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-48-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-48-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-48-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-336-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-336-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-336-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-336-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-720-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-720-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-336-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-336-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-720-2)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-720-2?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth1-720-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth1-720-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-336-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-336-1?p=long-term-series-forecasting-with-query)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/long-term-series-forecasting-with-query/time-series-forecasting-on-etth2-720-1)](https://paperswithcode.com/sota/time-series-forecasting-on-etth2-720-1?p=long-term-series-forecasting-with-query)`

Long-term series forecasting with Query Selector -- efficient model of sparse attention

19 Jul 2021 · Jacek Klimek, Jakub Klimek, Witold Kraskiewicz, Mateusz Topolewski ·

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT, Helpdesk and BPI'12 datasets.

PDF Abstract

Code

Add Remove Mark official

moraieu/query-selector official

moraieu/query-selector-classificati…

Tasks

Add Remove

Multivariate Time Series Forecasting

Time Series

Time Series Analysis

Time Series Forecasting

Datasets

Add Datasets introduced or used in this paper

Results from the Paper

Edit

Ranked #1 on Multivariate Time Series Forecasting on Helpdesk

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Multivariate Time Series Forecasting	BPI challenge '12	QuerySelector	Accuracy	0.79	# 1	Compare
Time Series Forecasting	ETTh1 (168) Multivariate	Transformer	MSE	0.7146	# 3	Compare
Time Series Forecasting	ETTh1 (168) Multivariate	Transformer	MAE	0.6325	# 2	Compare
Time Series Forecasting	ETTh1 (168) Multivariate	QuerySelector	MSE	0.6835	# 2	Compare
Time Series Forecasting	ETTh1 (168) Multivariate	QuerySelector	MAE	0.6088	# 3	Compare
Time Series Forecasting	ETTh1 (168) Univariate	QuerySelector	MSE	0.0935	# 2	Compare
Time Series Forecasting	ETTh1 (168) Univariate	QuerySelector	MAE	0.2371	# 3	Compare
Time Series Forecasting	ETTh1 (168) Univariate	Transformer	MSE	0.1049	# 3	Compare
Time Series Forecasting	ETTh1 (168) Univariate	Transformer	MAE	0.2539	# 2	Compare
Time Series Forecasting	ETTh1 (24) Multivariate	Transformer	MSE	0.4496	# 3	Compare
Time Series Forecasting	ETTh1 (24) Multivariate	Transformer	MAE	0.4788	# 2	Compare
Time Series Forecasting	ETTh1 (24) Multivariate	QuerySelector	MSE	0.4226	# 2	Compare
Time Series Forecasting	ETTh1 (24) Multivariate	QuerySelector	MAE	0.4627	# 3	Compare
Time Series Forecasting	ETTh1 (24) Univariate	Transformer	MSE	0.0548	# 4	Compare
Time Series Forecasting	ETTh1 (24) Univariate	Transformer	MAE	0.183	# 1	Compare
Time Series Forecasting	ETTh1 (24) Univariate	QuerySelector	MSE	0.0436	# 2	Compare
Time Series Forecasting	ETTh1 (24) Univariate	QuerySelector	MAE	0.1616	# 2	Compare
Time Series Forecasting	ETTh1 (336) Multivariate	Transformer	MSE	0.8321	# 11	Compare
Time Series Forecasting	ETTh1 (336) Multivariate	Transformer	MAE	0.7041	# 2	Compare
Time Series Forecasting	ETTh1 (336) Multivariate	QuerySelector	MSE	0.8503	# 12	Compare
Time Series Forecasting	ETTh1 (336) Multivariate	QuerySelector	MAE	0.7039	# 3	Compare
Time Series Forecasting	ETTh1 (336) Univariate	QuerySelector	MSE	0.1267	# 8	Compare
Time Series Forecasting	ETTh1 (336) Univariate	QuerySelector	MAE	0.2844	# 3	Compare
Time Series Forecasting	ETTh1 (336) Univariate	Transformer	MSE	0.1541	# 9	Compare
Time Series Forecasting	ETTh1 (336) Univariate	Transformer	MAE	0.3201	# 2	Compare
Time Series Forecasting	ETTh1 (48) Multivariate	Transformer	MSE	0.4668	# 3	Compare
Time Series Forecasting	ETTh1 (48) Multivariate	Transformer	MAE	0.4968	# 2	Compare
Time Series Forecasting	ETTh1 (48) Multivariate	QuerySelector	MSE	0.4581	# 2	Compare
Time Series Forecasting	ETTh1 (48) Multivariate	QuerySelector	MAE	0.4878	# 3	Compare
Time Series Forecasting	ETTh1 (48) Univariate	Transformer	MSE	0.074	# 3	Compare
Time Series Forecasting	ETTh1 (48) Univariate	Transformer	MAE	0.2144	# 2	Compare
Time Series Forecasting	ETTh1 (48) Univariate	QuerySelector	MSE	0.0721	# 2	Compare
Time Series Forecasting	ETTh1 (48) Univariate	QuerySelector	MAE	0.2118	# 3	Compare
Time Series Forecasting	ETTh1 (720) Multivariate	QuerySelector	MSE	1.115	# 13	Compare
Time Series Forecasting	ETTh1 (720) Multivariate	QuerySelector	MAE	0.8428	# 1	Compare
Time Series Forecasting	ETTh1 (720) Multivariate	Transformer	MSE	1.108	# 12	Compare
Time Series Forecasting	ETTh1 (720) Multivariate	Transformer	MAE	0.8399	# 2	Compare
Time Series Forecasting	ETTh1 (720) Univariate	QuerySelector	MSE	0.2136	# 11	Compare
Time Series Forecasting	ETTh1 (720) Univariate	QuerySelector	MAE	0.373	# 2	Compare
Time Series Forecasting	ETTh1 (720) Univariate	Transformer	MSE	0.2501	# 12	Compare
Time Series Forecasting	ETTh1 (720) Univariate	Transformer	MAE	0.4213	# 1	Compare
Time Series Forecasting	ETTh2 (168) Multivariate	Transformer	MSE	1.6225	# 3	Compare
Time Series Forecasting	ETTh2 (168) Multivariate	Transformer	MAE	0.9726	# 3	Compare
Time Series Forecasting	ETTh2 (168) Multivariate	QuerySelector	MSE	1.7385	# 4	Compare
Time Series Forecasting	ETTh2 (168) Multivariate	QuerySelector	MAE	1.0125	# 1	Compare
Time Series Forecasting	ETTh2 (168) Univariate	QuerySelector	MSE	0.1753	# 3	Compare
Time Series Forecasting	ETTh2 (168) Univariate	QuerySelector	MAE	0.3322	# 2	Compare
Time Series Forecasting	ETTh2 (168) Univariate	Transformer	MSE	0.1974	# 4	Compare
Time Series Forecasting	ETTh2 (168) Univariate	Transformer	MAE	0.3547	# 1	Compare
Time Series Forecasting	ETTh2 (24) Multivariate	QuerySelector	MSE	0.4124	# 2	Compare
Time Series Forecasting	ETTh2 (24) Multivariate	QuerySelector	MAE	0.4864	# 3	Compare
Time Series Forecasting	ETTh2 (24) Multivariate	Transformer	MSE	0.4237	# 3	Compare
Time Series Forecasting	ETTh2 (24) Multivariate	Transformer	MAE	0.5013	# 2	Compare
Time Series Forecasting	ETTh2 (24) Univariate	QuerySelector	MSE	0.0843	# 3	Compare
Time Series Forecasting	ETTh2 (24) Univariate	QuerySelector	MAE	0.2239	# 2	Compare
Time Series Forecasting	ETTh2 (24) Univariate	Transformer	MSE	0.0999	# 4	Compare
Time Series Forecasting	ETTh2 (24) Univariate	Transformer	MAE	0.2479	# 1	Compare
Time Series Forecasting	ETTh2 (336) Multivariate	Transformer	MSE	2.6617	# 13	Compare
Time Series Forecasting	ETTh2 (336) Multivariate	Transformer	MAE	1.2189	# 1	Compare
Time Series Forecasting	ETTh2 (336) Multivariate	QuerySelector	MSE	2.3168	# 12	Compare
Time Series Forecasting	ETTh2 (336) Multivariate	QuerySelector	MAE	1.1859	# 2	Compare
Time Series Forecasting	ETTh2 (336) Univariate	QuerySelector	MSE	0.2088	# 8	Compare
Time Series Forecasting	ETTh2 (336) Univariate	QuerySelector	MAE	0.371	# 2	Compare
Time Series Forecasting	ETTh2 (336) Univariate	Transformer	MSE	0.2191	# 10	Compare
Time Series Forecasting	ETTh2 (336) Univariate	Transformer	MAE	0.3805	# 1	Compare
Time Series Forecasting	ETTh2 (48) Multivariate	Transformer	MSE	1.522	# 4	Compare
Time Series Forecasting	ETTh2 (48) Multivariate	Transformer	MAE	0.9488	# 1	Compare
Time Series Forecasting	ETTh2 (48) Multivariate	QuerySelector	MSE	1.4074	# 3	Compare
Time Series Forecasting	ETTh2 (48) Multivariate	QuerySelector	MAE	0.9317	# 2	Compare
Time Series Forecasting	ETTh2 (48) Univariate	Transformer	MSE	0.1218	# 4	Compare
Time Series Forecasting	ETTh2 (48) Univariate	Transformer	MAE	0.2763	# 1	Compare
Time Series Forecasting	ETTh2 (48) Univariate	QuerySelector	MSE	0.1117	# 3	Compare
Time Series Forecasting	ETTh2 (48) Univariate	QuerySelector	MAE	0.2622	# 2	Compare
Time Series Forecasting	ETTh2 (720) Multivariate	QuerySelector	MSE	3.0664	# 12	Compare
Time Series Forecasting	ETTh2 (720) Multivariate	QuerySelector	MAE	1.3084	# 2	Compare
Time Series Forecasting	ETTh2 (720) Multivariate	Transformer	MSE	3.1805	# 13	Compare
Time Series Forecasting	ETTh2 (720) Multivariate	Transformer	MAE	1.3668	# 1	Compare
Time Series Forecasting	ETTh2 (720) Univariate	Transformer	MSE	0.2853	# 10	Compare
Time Series Forecasting	ETTh2 (720) Univariate	Transformer	MAE	0.434	# 11	Compare
Time Series Forecasting	ETTh2 (720) Univariate	QuerySelector	MSE	0.2585	# 8	Compare
Time Series Forecasting	ETTh2 (720) Univariate	QuerySelector	MAE	0.413	# 8	Compare
Multivariate Time Series Forecasting	Helpdesk	QuerySelector	Accuracy	0.743	# 1	Compare

Methods

Add Remove

Absolute Position Encodings • Adam • BPE • Dense Connections • Dropout • Label Smoothing • Layer Normalization • Linear Layer • Multi-Head Attention • Position-Wise Feed-Forward Layer • Residual Connection • Scaled Dot-Product Attention • Softmax • Transformer

Edit Social Preview

Long-term series forecasting with Query Selector -- efficient model of sparse attention

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove