TY - JOUR
T1 - Self-Attention-Based Deep Learning Network for Regional Influenza Forecasting
AU - Jung, Seungwon
AU - Moon, Jaeuk
AU - Park, Sungwoo
AU - Hwang, Eenjun
N1 - Funding Information:
Manuscript received March 13, 2021; revised May 15, 2021 and June 16, 2021; accepted June 27, 2021. Date of publication July 1, 2021; date of current version February 4, 2022. This work was supported by a Government-Wide R&D Fund Project for Infectious Disease Research (GFID), Republic of Korea under Grant HG19C0682. (Corresponding author: Eenjun Hwang.) The authors are with the School of Electrical Engineering, Korea University, Seoul 02841, South Korea (e-mail: jsw161@korea. ac.kr; jaewookmo@korea.ac.kr; psw5574@korea.ac.kr; ehwang04@ korea.ac.kr). Digital Object Identifier 10.1109/JBHI.2021.3093897
Publisher Copyright:
© 2013 IEEE.
PY - 2022/2/1
Y1 - 2022/2/1
N2 - Early prediction of influenza plays an important role in minimizing the damage caused, as it provides the resources and time needed to formulate preventive measures. Compared to traditional mechanistic approach, deep/machine learning-based models have demonstrated excellent forecasting performance by efficiently handling various data such as weather and internet data. However, due to the limited availability and reliability of such data, many forecasting models use only historical occurrence data and formulate the influenza forecasting as a multivariate time-series task. Recently, attention mechanisms have been exploited to deal with this issue by selecting valuable data in the input data and giving them high weights. Particularly, self-attention has shown its potential in various forecasting tasks by utilizing the predictive relationship between objects from the input data describing target objects. Hence, in this study, we propose a forecasting model based on self-attention for regional influenza forecasting, called SAIFlu-Net. The model exploits a long short-term memory network for extracting time-series patterns of each region and the self-attention mechanism to find the similarities between the occurrence patterns. To evaluate its performance, we conducted extensive experiments with existing forecasting models using weekly regional influenza datasets. The results show that the proposed model outperforms other models in terms of root mean square error and Pearson correlation coefficient.
AB - Early prediction of influenza plays an important role in minimizing the damage caused, as it provides the resources and time needed to formulate preventive measures. Compared to traditional mechanistic approach, deep/machine learning-based models have demonstrated excellent forecasting performance by efficiently handling various data such as weather and internet data. However, due to the limited availability and reliability of such data, many forecasting models use only historical occurrence data and formulate the influenza forecasting as a multivariate time-series task. Recently, attention mechanisms have been exploited to deal with this issue by selecting valuable data in the input data and giving them high weights. Particularly, self-attention has shown its potential in various forecasting tasks by utilizing the predictive relationship between objects from the input data describing target objects. Hence, in this study, we propose a forecasting model based on self-attention for regional influenza forecasting, called SAIFlu-Net. The model exploits a long short-term memory network for extracting time-series patterns of each region and the self-attention mechanism to find the similarities between the occurrence patterns. To evaluate its performance, we conducted extensive experiments with existing forecasting models using weekly regional influenza datasets. The results show that the proposed model outperforms other models in terms of root mean square error and Pearson correlation coefficient.
KW - Artificial neural networks
KW - deep learning
KW - regional influenza forecasting
KW - self-attention
UR - http://www.scopus.com/inward/record.url?scp=85112183493&partnerID=8YFLogxK
U2 - 10.1109/JBHI.2021.3093897
DO - 10.1109/JBHI.2021.3093897
M3 - Article
C2 - 34197330
AN - SCOPUS:85112183493
SN - 2168-2194
VL - 26
SP - 922
EP - 933
JO - IEEE Journal of Biomedical and Health Informatics
JF - IEEE Journal of Biomedical and Health Informatics
IS - 2
ER -