MAY 5, 2011 9:56am ET

Related Links

Business Analytics Services Spending to Reach $89.6 billion in 2018
September 15, 2014
Artificial Intelligence Meets the C-suite
September 15, 2014
Mayo Clinic to Use Watson to Bolster Trial Enrollments
September 11, 2014

Web Seminars

Essential Guide to Using Data Virtualization for Big Data Analytics
September 24, 2014
Integrating Relational Database Data with NoSQL Database Data
October 23, 2014

The Dichotomy Paradox, Data Quality and Zero Defects

Print
Reprints
Email

As Joseph Mazur explains in “Zeno’s Paradox,” the ancient Greek philosopher Zeno constructed a series of logical paradoxes to prove that motion is impossible, which today remain on the cutting edge of our investigations into the fabric of space and time.

Get access to this article and thousands more...

All Information Management articles are archived after 7 days. REGISTER NOW for unlimited access to all recently archived articles, as well as thousands of searchable stories. Registered Members also gain access to:

  • Full access to information-management.com including all searchable archived content
  • Exclusive E-Newsletters delivering the latest headlines to your inbox
  • Access to White Papers, Web Seminars, and Blog Discussions
  • Discounts to upcoming conferences & events
  • Uninterrupted access to all sponsored content, and MORE!

Already Registered?

Advertisement

Comments (5)
I'm of the opinion that there are no perfectionist's working in data quality so there is no need for concern. The metrics used in data quality themselves are inexact. The business cases for data quality contain abstract terms such as fitness for use good enough pursuit of excellence customer satisfaction data as an asset and other marketing blather. The data quality published results are subject to "adjustments" to make them appear entertaining on the dashboards so as to ensure continued employment or engagement.

If only there were some perfectionists among us we might expose the fallacies of data quality. Data quality is a myth. It's not the data that's defective it's the policies and processes. But those policies and process are "sacred cows" and questioning them can result in banishment.

Data quality practices have become motionless because they have reached the limits of the fallacies on which the practices were constructed. If an organization is using "incorrect" data that has been shown to be incorrect is that a data quality issue? There are numerous examples of this across many industries. Yet these are not addressed in any of the data quality literature. Systemically bad data is of greater impact to businesses and the economy but we are told fixing data in our miniature worlds is sufficient. The impact is minimal while the egregious data quality errors continue. Out approach to data quality is simplistic and myopic. We need some perfectionists to come out and expose these fallacies.

I don't hear requests for zero defects in data. A data value that contains zero defects doesn't exist. It has been relegated to a black hole never to be seen. It is the absence of everything all knowledge meaning and life therefore striving for zero defect data could be harmful to the universe and I suggest we not experiment with this phenomena. It could result in a singularity.

Posted by Richard O | Friday, May 06 2011 at 10:54AM ET
"Zero defects" even in manufacturing is just a slogan because as you say one would have to perform an infinite number of quality control steps to insure this.

A truer statement would be "the probability of a defect is acceptably small". Then it is up to the business to define "acceptably small" based on cost (the cost of meeting that quality goal minus the cost when a defect ocurrs).

That does not mean thopugh that the business could not say "we do not want a defect to occur in 100 years" - they could - but at least then you can define the steps required and the cost of achieving this.

Posted by Martin L | Friday, May 06 2011 at 11:03AM ET
Add Your Comments:
You must be registered to post a comment.
Not Registered?
You must be registered to post a comment. Click here to register.
Already registered? Log in here
Please note you must now log in with your email address and password.
Twitter
Facebook
LinkedIn
Login  |  My Account  |  White Papers  |  Web Seminars  |  Events |  Newsletters |  eBooks
FOLLOW US
Please note you must now log in with your email address and password.