Details zur Publikation

Kategorie Textpublikation
Referenztyp Zeitschriften
Lizenz creative commons licence
Titel (primär) A scalable pipeline for COVID-19: the case study of Germany, Czechia and Poland
Autor Abdussalam, W.; Mertel, A.; Fan, K.; Schüler, L.; Schlechte-Wełnicz, W.; Calabrese, J.M.
Journal / Serie CEUR Workshop Proceedings
Erscheinungsjahr 2022
Department OESA; MET
Band/Volume 3306
Seite von 64
Seite bis 75
Sprache englisch
Topic T5 Future Landscapes
Abstract Throughout the coronavirus disease 2019 (COVID-19) pandemic, decision makers have relied on forecasting models to determine and implement non-pharmaceutical interventions (NPI). In building the forecasting models, continuously updated datasets from various stakeholders including developers, analysts, and testers are required to provide precise predictions. Here we report the design of a scalable pipeline which serves as a data synchronization to support inter-country top-down spatiotemporal observations and forecasting models of COVID-19, named the where2test, for Germany, Czechia and Poland. We have built an operational data store (ODS) using PostgreSQL to continuously consolidate datasets from multiple data sources, perform collaborative work, facilitate high performance data analysis, and trace changes. The ODS has been built not only to store the COVID-19 data from Germany, Czechia, and Poland but also other areas. Employing the dimensional fact model, a schema of metadata is capable of synchronizing the various structures of data from those regions, and is scalable to the entire world. Next, the ODS is populated using batch Extract, Transfer, and Load (ETL) jobs. The SQL queries are subsequently created to reduce the need for pre-processing data for users. The data can then support not only forecasting using a version-controlled Arima-Holt model and other analyses to support decision making, but also risk calculator and optimisation apps [1, 2]. The data synchronization runs at a daily interval, which is displayed at
dauerhafte UFZ-Verlinkung
Abdussalam, W., Mertel, A., Fan, K., Schüler, L., Schlechte-Wełnicz, W., Calabrese, J.M. (2022):
A scalable pipeline for COVID-19: the case study of Germany, Czechia and Poland
CEUR Workshop Proceedings 3306 , 64 - 75