Data Migration

Migration is a key process in the data warehousing environment. Data migration involves the integration of data from multiple sources to a common repository for building data warehouses and updating systems. During such a process, there is a likelihood of data being lost in flight. It is of paramount importance therefore to circumvent this risk and maintain data integrity. This may be achieved by validating the data that is transferred from the source to the target system. As manually performed validation is a time consuming and cumbersome task, an automated process is the ideal resolution. The automated process of validation is performed using a prototype version with respect to character count, null value detection and inadvertent entry of unnecessary data. Migration is then effected from different source tables to target tables.