MURAL - Maynooth University Research Archive Library



    The ‘dirty dozen’ of freshwater science: detecting then reconciling hydrological data biases and errors


    Wilby, Robert L., Clifford, Nicolas J., De Luca, Paola, Harrigan, Shaun, Hillier, John K., Hodgkins, Richard, Johnson, Matthew F., Matthews, Tom K.R., Murphy, Conor, Noone, Simon, Parry, Simon, Prudhomme, Christel, Rice, Steve P., Slater, Louise J., Smith, Karen A. and Wood, Paul J. (2017) The ‘dirty dozen’ of freshwater science: detecting then reconciling hydrological data biases and errors. WIREs Water.

    [thumbnail of CM_dirty dozen 2017.pdf]
    Preview
    Text
    CM_dirty dozen 2017.pdf

    Download (2MB) | Preview

    Abstract

    Sound water policy and management rests on sound hydrometeorological and ecological data. Conversely, unrepresentative, poorly collected, or erroneously archived data introduce uncertainty regarding the magnitude, rate, and direction of environmental change, in addition to undermining confidence in decision-making processes. Unfortunately, data biases and errors can enter the information flow at various stages, starting with site selection, instrumentation, sampling/measurement procedures, postprocessing and ending with archiving systems. Techniques such as visual inspection of raw data, graphical representation, and comparison between sites, outlier, and trend detection, and referral to metadata can all help uncover spurious data. Tell-tale signs of ambiguous and/or anomalous data are highlighted using 12 carefully chosen cases drawn mainly from hydrology (‘the dirty dozen’). These include evidence of changes in site or local conditions (due to land management, river regulation, or urbanization); modifications to instrumentation or inconsistent observer behavior; mismatched or misrepresentative sampling in space and time; treatment of missing values, postprocessing and data storage errors. Also for raising awareness of pitfalls, recommendations are provided for uncovering lapses in data quality after the information has been gathered. It is noted that error detection and attribution are more problematic for very large data sets, where observation networks are automated, or when various information sources have been combined. In these cases, more holistic indicators of data integrity are needed that reflect the overall information life-cycle and application(s) of the hydrological data.
    Item Type: Article
    Keywords: ‘dirty dozen’; freshwater science; detecting; reconciling; hydrological data biases; errors;
    Academic Unit: Faculty of Social Sciences > Geography
    Faculty of Social Sciences > Research Institutes > Irish Climate Analysis and Research Units, ICARUS
    Item ID: 8883
    Identification Number: 10.1002/wat2.1209
    Depositing User: Conor Murphy
    Date Deposited: 11 Oct 2017 13:34
    Journal or Publication Title: WIREs Water
    Publisher: Wiley
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/8883
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads