I have several years in QA and testing of software and am now working on my first data warehouse assignment. I am having trouble locating books/articles specific to the QA and/or testing of data warehouses. I am also having trouble finding specific tools for testing data at each stage of the ETL process. Can you make any recommendations?
Clay Rehm's Answer: Even though there is a lack of documentation on this subject, the Object Oriented (OO) approach to software development including the Rational Unified Process (RUP) offer great solutions and techniques to the development and testing of software which includes the development of ETL processes.
Chuck Kelley's Answer: I don't know of specific tools, but what I like to do is to calculate at the end of each stage the number of rows input, output, rejected, and grouped. I like to do same with the measures. Then if the input and output (rejected and grouped) are equal then everything is in the warehouse. Next I like to run high level queries to make sure the data is grouped properly and within specified ranges (+/-2 percent or whatever the business believes is reasonable).
Register or login for access to this item and much more
All Information Management content is archived after seven days.
Community members receive:
- All recent and archived articles
- Conference offers and updates
- A full menu of enewsletter options
- Web seminars, white papers, ebooks
Already have an account? Log In
Don't have an account? Register for Free Unlimited Access