A collaborative analysis framework for distributed gridded environmental data

Abstract As the amount of environmental data expands exponentially worldwide, researchers are challenged to efficiently analyze data maintained in multiple data centers. Because distributed data access, server-side analysis, multinode collaboration, and extensible analytic functions are still research gaps in this field, this paper introduces a collaborative analysis framework for gridded environmental data, i.e. CAFE. Multiple CAFE nodes can collaborate to perform complex data analysis. Analytic functions are performed near where data are stored. A web-based user interface allows researchers to search for data of interest, submit analytic tasks, check the status of tasks, visualize the analysis results, and download the resulting data files. CAFE facilitates overall research efficiency by dramatically lowering the amount of data that must be transmitted from data centers to researchers for analysis. The results of this study may lead to the further development of collaborative computing paradigm for environmental data analysis.