Frictionless Data Processing in the Wild
MetadataShow full item record
Keywordopen data; frictionless data; datapackage-pipelines; open knowledge; data processing; provenance; interoperability; FAIR; workflows
Frictionless Data (FD) initiatives out of the Open Knowledge Foundation provide attractive informatics and processing capabilities. The BCO-DMO data repository used FD tools on real-world datasets, and we have some lessons learned to share. By building upon existing FD tools, we found ways to reduce the amount of time data managers spend generating metadata, and writing custom scripts. We are also developing ways for data managers with varying levels of scripting ability to make use of Frictionless Data tools.
Presented at csv,conf,v4 Conference Portland, Oregon, May 5-8, 2019.
Suggested CitationPresentation: York, Amber, Schloer, Conrad, Copley, Nancy, Biddle, Matt, Rauch, Shannon, Haskins, Christina, Soenen, Karen, Shepherd, Adam, Kinkade, Danie, "Frictionless Data Processing in the Wild", Presented at csv,conf,v4 Conference Portland, Oregon, May 5-8, 2019., DOI:10.5281/zenodo.2687557, https://hdl.handle.net/1912/24143
The following license files are associated with this item:
Showing items related by title, author, creator and subject.
Shepherd, Adam; Rauch, Shannon; Schloer, Conrad; Kinkade, Danie; Biddle, Matt; Copley, Nancy; Saito, Mak A.; Wiebe, Peter; York, Amber (2018-12-14)Data repositories often transform submissions to improve understanding and reuse of data by researchers other than the original submitter. However, scientific workflows built by the data submitters often depend on the ...
Shepherd, Adam; Fils, Douglas; Kinkade, Danie; Saito, Mak A. (2018-02-15)At the Biological and Chemical Oceanography Data Management Office (BCO-DMO) Big Data challenges have been steadily increasing. The sizes of data submissions have grown as instrumentation improves. Complex data types can ...