Do you have any information regarding quality edits and procedures for loading warehouses and verifying data before releasing to the business groups?
Sid Adelman's Answer: Be sure to verify the data before releasing it to the business groups. Most data warehouses have had data quality problems, and if they are not corrected before the users perform their queries, the data warehouse (and you) will lose credibility. Users often stop writing queries if they believe the data is bad. It takes a long time to restore credibility.
Larissa Moss's Answer: I would like to refer you to the article, "Data Cleansing: A Dichotomy of Data Warehousing" published in DM Review in February, 1998. This article has an extensive discussion of various categories of "dirty data" to be edited. Another series of articles called "Measure Twice - Cut Once," published in DM Review April 1999 (Part I), May 1999 (Part II), June 1999 (Part III) talks in detail about procedures for the ETL (extract/transform/load) process to the data warehouses.
Register or login for access to this item and much more
All Information Management content is archived after seven days.
Community members receive:
- All recent and archived articles
- Conference offers and updates
- A full menu of enewsletter options
- Web seminars, white papers, ebooks
Already have an account? Log In
Don't have an account? Register for Free Unlimited Access