Show simple item record

dc.contributor.authorVance, Tiffany C.  Concept link
dc.contributor.authorWengren, Micah  Concept link
dc.contributor.authorBurger, Eugene  Concept link
dc.contributor.authorHernandez, Debra  Concept link
dc.contributor.authorKearns, Timothy  Concept link
dc.contributor.authorMedina-Lopez, Encarni  Concept link
dc.contributor.authorMerati, Nazila  Concept link
dc.contributor.authorO'Brien, Kevin  Concept link
dc.contributor.authorO’Neil, Jon  Concept link
dc.contributor.authorPotemra, James T.  Concept link
dc.contributor.authorSignell, Richard P.  Concept link
dc.contributor.authorWilcox, Kyle  Concept link
dc.date.accessioned2019-07-05T18:20:49Z
dc.date.available2019-07-05T18:20:49Z
dc.date.issued2019-05-21
dc.identifier.citationVance, T. C., Wengren, M., Burger, E., Hernandez, D., Kearns, T., Medina-Lopez, E., Merati, N., O'Brien, K., O'Neil, J., Potemrag, J. T., Signell, R. P., & Wilcox, K. (2019). From the oceans to the cloud: Opportunities and challenges for data, models, computation and workflows. Frontiers in Marine Science, 6, 211.en_US
dc.identifier.urihttps://hdl.handle.net/1912/24316
dc.description© The Author(s), 2019. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Vance, T. C., Wengren, M., Burger, E., Hernandez, D., Kearns, T., Medina-Lopez, E., Merati, N., O'Brien, K., O'Neil, J., Potemrag, J. T., Signell, R. P., & Wilcox, K. From the oceans to the cloud: Opportunities and challenges for data, models, computation and workflows. Frontiers in Marine Science, 6(211), (2019), doi:10.3389/fmars.2019.00211.en_US
dc.description.abstractAdvances in ocean observations and models mean increasing flows of data. Integrating observations between disciplines over spatial scales from regional to global presents challenges. Running ocean models and managing the results is computationally demanding. The rise of cloud computing presents an opportunity to rethink traditional approaches. This includes developing shared data processing workflows utilizing common, adaptable software to handle data ingest and storage, and an associated framework to manage and execute downstream modeling. Working in the cloud presents challenges: migration of legacy technologies and processes, cloud-to-cloud interoperability, and the translation of legislative and bureaucratic requirements for “on-premises” systems to the cloud. To respond to the scientific and societal needs of a fit-for-purpose ocean observing system, and to maximize the benefits of more integrated observing, research on utilizing cloud infrastructures for sharing data and models is underway. Cloud platforms and the services/APIs they provide offer new ways for scientists to observe and predict the ocean’s state. High-performance mass storage of observational data, coupled with on-demand computing to run model simulations in close proximity to the data, tools to manage workflows, and a framework to share and collaborate, enables a more flexible and adaptable observation and prediction computing architecture. Model outputs are stored in the cloud and researchers either download subsets for their interest/area or feed them into their own simulations without leaving the cloud. Expanded storage and computing capabilities make it easier to create, analyze, and distribute products derived from long-term datasets. In this paper, we provide an introduction to cloud computing, describe current uses of the cloud for management and analysis of observational data and model results, and describe workflows for running models and streaming observational data. We discuss topics that must be considered when moving to the cloud: costs, security, and organizational limitations on cloud use. Future uses of the cloud via computational sandboxes and the practicalities and considerations of using the cloud to archive data are explored. We also consider the ways in which the human elements of ocean observations are changing – the rise of a generation of researchers whose observations are likely to be made remotely rather than hands on – and how their expectations and needs drive research towards the cloud. In conclusion, visions of a future where cloud computing is ubiquitous are discussed.en_US
dc.description.sponsorshipThis is PMEL contribution 4873.en_US
dc.publisherFrontiers Mediaen_US
dc.relation.urihttps://doi.org/10.3389/fmars.2019.00211
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.subjectocean observationen_US
dc.subjectocean modeling and predictionen_US
dc.subjectclouden_US
dc.subjectdata managementen_US
dc.subjectarchivingen_US
dc.subjecttechnologyen_US
dc.titleFrom the oceans to the cloud: Opportunities and challenges for data, models, computation and workflows.en_US
dc.typeArticleen_US
dc.identifier.doi10.3389/fmars.2019.00211


Files in this item

Thumbnail
Thumbnail

This item appears in the following Collection(s)

Show simple item record

Attribution 4.0 International
Except where otherwise noted, this item's license is described as Attribution 4.0 International