We are building a data warehouse with many source systems that provide data feeds. In order to reduce the volume of data, we only apply the changes (change, new, delete) into the data warehouse. We have two choices: 1) Every source system provides a change image file, or 2) Every source system provides the current image file. A data warehouse process would compare the current image file and previous image file and output the change image. Do you have any recommendation on which approach is preferable? Is there any ETL tool, RDBMS, or third party tool that provides the functionality to compare data and output to a change image file?

Register or login for access to this item and much more

All Information Management content is archived after seven days.

Community members receive:
  • All recent and archived articles
  • Conference offers and updates
  • A full menu of enewsletter options
  • Web seminars, white papers, ebooks

Don't have an account? Register for Free Unlimited Access