Q: We are in the design phase of a data warehouse, stuck with a change data capture issue, where the source system is JDE and the source tables don't have proper timestamp capture for the updates and inserts, which deprives us of proper incremental load capture. It is not an option to use the source transaction logs for change data capture. A third option of full-table comparison leads to major overhead, so even that is ruled out. What would be the best solution other than the three options above? Do you have any suggestions regarding the "check sum" method? How feasible is the method and how would we achieve it?
I did some testing and wrote about the check sum method about three years ago. I think that it works and may be the only solution you have left to do. You may be able to use a different algorithm (I like the MD5) to do this. Also, the full table comparison should not be ruled out. There are great techniques that can deal with this, unless you are running on a Windows server.
Register or login for access to this item and much more
All Information Management content is archived after seven days.
Community members receive:
- All recent and archived articles
- Conference offers and updates
- A full menu of enewsletter options
- Web seminars, white papers, ebooks
Already have an account? Log In
Don't have an account? Register for Free Unlimited Access