Publication Details

Category Text Publication
Reference Category Conference papers
DOI 10.5194/egusphere-egu26-17347
Licence creative commons licence
Title (Primary) From architecture to operation: time.IO a user-centric digital ecosystem for time series data management in Earth system science
Title (Secondary) EGU General Assembly 2026, Vienna, Austria, 3-8 May 2026
Author Schäfer, D.; Brinckmann, N.; Gransee, F.; Kuhnert, T.; Kunkel, R.; Lorenz, C.; Lünenschloß, P.; Palm, B. ORCID logo ; Schnicke, T. ORCID logo ; Bumberger, J. ORCID logo
Source Titel EGUsphere
Year 2026
Department MET; WKDV
Page From EGU26-17347
Language englisch
Topic T5 Future Landscapes
Abstract

Research Data Infrastructures (RDIs) in Earth System Science must balance FAIR-compliant data management, operational requirements, and the practical needs of researchers operating heterogeneous sensor networks at scale. These design goals are not always fully aligned and may even conflict in operational environments. At the EGU General Assembly 2025, we introduced a modular digital ecosystem for time series data management designed to address these challenges. One year later, we report on the transition from prototype deployment to sustained operational use and reflect on how user feedback and operational constraints shaped the system’s evolution.

The ecosystem has since been deployed as a production infrastructure at the Helmholtz Centre for Environmental Research - UFZ, where it currently supports approximately 20 research projects. The system manages around three billion observations from diverse sensor networks, with temporal resolutions of up to 5 seconds. This operational setting exposed challenges that were not fully apparent at the design and implementation stages, particularly regarding the scalability of data integration workflows, robustness under continuous load, and the interaction between metadata management, data ingestion, and automated quality control.

The ecosystem comprises three modular components: the Sensor Management System – SMS [1] for standardized metadata registration, the time.IO [2] platform for storage, transfer, and visualization of time series data, and the System for Automated Quality Control – SaQC [3] for automated data analysis and quality assurance. While the modular design enabled reuse and interoperability, early operational phases revealed scaling bottlenecks that led to service outages, necessitating substantial refinements of ingestion pipelines, deployment strategies, and monitoring mechanisms.

User-centric development also played a central role in stabilizing and extending the infrastructure. Continuous feedback from active projects influenced interface design, automation levels, and operational workflows, highlighting the importance of iterative co-design in bridging the gap between conceptual design goals and sustainable, user-accepted operation. We summarize key lessons learned from one year of operational use and discuss implications for building and operating sustainable, interoperable RDIs that effectively support Earth system science across disciplines and scales.

Schäfer, D., Brinckmann, N., Gransee, F., Kuhnert, T., Kunkel, R., Lorenz, C., Lünenschloß, P., Palm, B., Schnicke, T., Bumberger, J. (2026):
From architecture to operation: time.IO a user-centric digital ecosystem for time series data management in Earth system science
EGU General Assembly 2026, Vienna, Austria, 3-8 May 2026
EGUsphere
Copernicus Publications, EGU26-17347 10.5194/egusphere-egu26-17347