We’ve all heard about the importance of data quality in our IT systems and how the data that flows through our applications is the fuel of the business processes. Yet, surprisingly few organizations have a structured approach to measuring the quality of their data. Some may have a few custom reports or manually compiled Excel sheets that show a few aspects of data quality, but if information is truly an enterprise asset, shouldn’t we be measuring and monitoring it like we do with all the other assets of the organization? Like most other things, data quality can only be managed properly if it is measured and monitored.The main reasons for implementing a data quality monitoring concept are to ensure that you identify:
Looking at the offerings of many data profiling and data quality tool vendors, one could be led to think that data quality is just about checking if all fields have a value and if it’s valid compared to the domain that is defined for that specific field. While these are certainly relevant aspects of data quality, they only represent two out of the six common dimensions of data quality.When defining a data quality measuring concept, you should aim to focus on the dimensions that are meaningful and relevant for the business without spending too many resources, i.e., you need to justify the business relevance of what you measure. On the other hand, measuring all the different dimensions of data quality gives you the most complete picture. For instance, what is it worth to have a valid address for a customer if it is not correct because the customer has moved?A challenge that organizations face as they attempt to define data quality key performance indicators is that completeness, validity and integrity may be relatively easy to measure, but measuring consistency, accuracy and timeliness is a whole other story. In general, we would argue that the relationship illustrated in Figure 2 exists between the difficulty of measurement and the business impact.Because accuracy, timeliness and consistency are the more complex dimensions to measure, here are a few hints on how to address them.
Register or login for access to this item and much more
All Information Management content is archived after seven days.
Community members receive:
- All recent and archived articles
- Conference offers and updates
- A full menu of enewsletter options
- Web seminars, white papers, ebooks
Already have an account? Log In
Don't have an account? Register for Free Unlimited Access