R3.5 Request for Comment
Existing Dimension: Consistency
New Underlying Concept: Temporal Consistency
With the work by D. Myers and B. Blake (2017), it has become apparent that the Consistency Dimension should include an additional Underlying Concept to measure the aspects of uniformity of values over time.
As a result of researching Reasonability, Myers and Blake created the following table (Appendix D, Authors Citing Believability and Related Dimensions). (Table only includes rows from two authors citing related concepts, and perinate cells are highlighted in green. To access the full table, see Myers/Blake 2017)
Author [Reference] |
Dimension |
Dimension Definition |
Metric |
Metric Definition |
Prat and Madnick (2008) |
Believability- Trustworthiness of Source |
The extent to which a data value ordinates from trustworthy sources. |
|
|
Believability- Reasonableness of Data |
The extent to which a data value is reasonable (likely). |
Possibility |
The extent to which a data value is possible |
|
Consistency |
Definition: The extent to which a data value is consistent with other values of the same data. |
|||
Believability- Temporality of Data |
The extent to which a data value is credible based on transaction and |
Transaction and valid times closeness |
The extent to which a data value is credible based on proximity of transaction time to valid times. |
|
Valid times overlap |
The extent to which a data value is derived from data values with overlapping valid times. |
|||
Loshin (2011) |
Reasonableness |
General statements associated with expectations of consistency or reasonability of values, either in the context of existing data or over a time series, are included in this dimension. |
Multi-value consistency |
The value of one set of attributes is consistent with the values of another set of attributes. |
Temporal reasonability |
New values are consistent with expectations based on previous values. |
|||
Agreements |
Service level agreements (SLA), security agreements, and other authoritative documents governing data provider performance will be defined. |
|||
Reasonableness |
The data meet rational expectations. |
|||
Data correction |
When possible, poor data quality will be improved by implementing data correction processes. |
Drawing on Prat and Madnick (2008) and Loshin (2011), the following support for this new Underlying Concept is as follows:
Therefore, the new Underlying Concept added to the Conformed Dimensions as of Release 3.5 will be:
Underlying Concept |
Definition |
Temporal Consistency |
The measure of uniformity of the data compared to historical values. |
Your input is valued and appreciated. Please direct comments to Dan Myers (dan[at]dqmatters[dot]com) or the LinkedIn group for the Conformed Dimensions of Data Quality.
References: