Question: How important is data reconciliation for an ETL application? What are the steps involved in data reconciliation of the same?

Sid Adelman's Answer: The reconciliation is critical. If you do not reconcile, you have no way of knowing if the ETL process completed successfully and the business users rarely have any way of performing their own reconciliation. This means they may be dealing with old data (they may assume it is current) and the data may be incomplete. These users will produce incorrect results and when the cause is determined, they will point to you. You should be looking at tie-outs which include certification of the number of rows loaded and verification of numbers within the database. Tie-outs are standard features of the ETL tools but they have to be turned on and someone has to verify the results and this must be done each time the ETL process is complete.

Register or login for access to this item and much more

All Information Management content is archived after seven days.

Community members receive:
  • All recent and archived articles
  • Conference offers and updates
  • A full menu of enewsletter options
  • Web seminars, white papers, ebooks

Don't have an account? Register for Free Unlimited Access