GOSIC Banner
 
Facilitating Access to Global Observing Systems Data and Information

The Data Flow Diagrams

It is important to document the responsibilities of data and scientific centers and the data flows and schedules for an operational data system. The allows users to understand at what timescales and at what state in the processing data might be available for their applications. It also allows managers of the data systems to identify and solve problems with a data flow at an early date.

Updated July 7, 2009

The Diagrams

A data flow diagram provides a visual representation of the data flow. Users can see where and when the data and information can be accessed at various stages of its life cycle. It is useful to include clickable information on responsibilities of the centers, schedules, data formats, data volumes, etc.

Access to the data at intermediate points in the data flow and information on data and product delivery can also be provided through these diagrams.

The data flow diagrams are not widely implemented on the GOSIC Portal as yet. This feature needs further development in consultation with representative data centers handling Global Observing Systems (GCOS, GOOS and GTOS) data and products.

The GCOS Upper Air Network provides an example data flow diagram. Some of the data flow diagrams on the GOSIC Portal have been developed by the GOSIC, others are provided by the observing system programs themselves.

Access the Data Flow Diagrams

Unique Approaches to this Requirement

Need for automation. Monitoring of data flows in the past has often been manual and time consuming even though this activity is amenable to automation. The GOSIC proposes to explore in cooperation with the Global Observing Systems (GCOS, GOOS and GTOS) Data Coordinators how this situation can be improved.

Data Coordinators. Data Coordinators for each of the Global Observing Systems programs are an activity that should be implemented to assure data-flow monitoring. This is not a task for the GOSIC, but rather one that can be effectively supported using the information available in the GOSIC and the access that is being developed to the data centers.

Support to data flow monitoring by the scientific and data centers. Centers would be expected to prepare and post data flow monitoring products for use by the data coordinators as in the GTSPP example below.

See an example of a data flow monitoring product for the GTSPP.