Document Details

Title Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data
Archive All Files / Documents / Presentations / Oral Presentations
Abstract

Quality Control of high volume, real-time data from automated sensors is an emerging challenge. Traditional techniques (e.g. plotting, statistics) often don't scale well. As a result, data validation and quality control can be a limiting factor in getting data online. Difficulties can also lead to release delays or posting provisional data. The GCE Data Toolbox (MATLAB-based software developed at GCE-LTER) has proven useful for Q/C of real-time data. This software was designed to automate GCE data processing, QA/QC and metadata generation, but is very generalized and supports any tabular data. It also provides a dynamic, rule-based Q/C framework for data processing, analysis and synthesis.

Contributor Wade M. Sheldon
Citation

Sheldon, W.M. Jr. 2011. Presentation: Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data. Streaming QA/QC. Northeast Environmental Sensor Workshop, October 24-27, 2011, Hubbard Brook Experimental Forest, Woodstock, New Hampshire.

Key Words data, MATLAB, quality control, sensor, statistics, toolbox
File Date 2011
Web Link PDF file
view/download PDF file
LTER
NSF

This material is based upon work supported by the National Science Foundation under grants OCE-9982133, OCE-0620959 and OCE-1237140. Any opinions, findings, conclusions, or recommendations expressed in the material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.