Continue in 2 seconds

Managed Meta Data Environment: A Complete Walk-Through, Part 6

  • September 01 2004, 1:00am EDT

This column is adapted from the book Universal Meta Data Models by David Marco & Michael Jennings (John Wiley & Sons).

In the last several columns, I presented the six major components of a managed meta data environment (MME): meta data sourcing layer, meta data integration layer, meta data repository, meta data management layer, meta data marts and meta data delivery layer. This installment will discuss the MME's fourth component, the meta data management layer.

The meta data management layer provides systematic management of the meta data repository and the other MME components (see Figure 1). As with other layers, the approach to this component greatly differs depending on whether a meta data integration tool is used or if the entire MME is custom-built. If an enterprise meta data integration tool is used for the construction of the MME, then a meta data management interface is most likely built within the product. If it is not built in the product, you would need to do a custom build. The meta data management layer performs the following functions: archive, backup, database modifications, database tuning, environment management, job scheduling, load statistics, purging, query statistics, query and report generation, recovery, security processes, source mapping and movement, user interface management and versioning.

Archive. The archive function allows the meta data architect to set the criteria or event that triggers the MME archiving process. It should be able to archive all of the meta data in the meta data repository and the related meta data marts, and it should allow for specific meta data tables to be archived when necessary.

Backup. Backup functionality is often confused with archiving. Archiving targets the storage of older and less-needed versions of the MME, while backups refer to the process of making sure the current MME is stored in a separate database so that a backup version can be brought online if the production version of the MME is corrupted or if any of its components fail. Often, the backup strategy is implemented at a hardware level through the use of disk mirroring. Best practices in this area include storing the copy in a different physical location than the production version of the MME.

Database Modifications. Because the meta model is implemented in an open, relational database, often tables and columns within the meta model need to be added, modified or deleted. The meta data management layer needs to not only assist in this process, but also track the changes that have been made to the MME.

Database Tuning. Tuning of the meta data repository and its associated meta data marts is a very important part of the meta data management layer. First, identifying indexes ensures that reports run efficiently. When analyzing physical meta model structures, it is common to only see indexes on primary keys. This is typically a sign of the lack of or poor indexing strategies. Second, database tuning helps you identify and remove dormant meta data within the repository. A large MME that has been in production for a few years commonly has a good deal of dormant meta data. A sound MME will contain meta data that provides operational measurement statistics on the use of meta data in the MME to assist in the identification of dormant meta data.

Figure 1: Meta Data Management Layer

Environment Management. Many meta data professionals make the mistake of believing that when they implement a MME, they are implementing and maintaining one system. In reality, they are building and maintaining three (possibly more) systems: production, testing and development.

The production version of the MME is the system that is in the "production environment" of an organization and is the version of the MME that the end users access. The testing environment is the version used to test changes to system "bugs" found in the production version of the MME. The development version of the MME is used to test future major MME enhancements.

The names and number of MME environments differ based on the organization's internal IT standards; however, the three environments mentioned here are the most common. In any event, a good meta data management layer can handle any required number of environments and names. The environment management portion of the meta data management layer needs to organize and control the management and migration between these three system versions.

Job Scheduling. The program and process jobs that are executed to load and to access the MME need to be scheduled and managed. The job-scheduling portion of the meta data management layer is responsible for both event-based and batch-triggered job scheduling.

Load Statistics. The meta data extraction and integration layers of the MME generate a great deal of valuable MME loading statistics. These MME load statistics need to be historically stored within the meta data repository portion of the MME. Examples of the most common types of load statistics include:

  • How long did it take a particular process tread to run (clock time and CPU time)?
  • How long did the entire meta data extraction and integration layers take to run (both clock and CPU time)?
  • What errors were encountered in the meta data extraction and integration layers?
  • What were the categories (e.g., informational, warning, severe, critical, etc.) of the errors that were logged?
  • How many rows were inserted, changed or deleted in each table of the meta model?

Next month I will finish walking through the functions of the meta data management layer.

Register or login for access to this item and much more

All Information Management content is archived after seven days.

Community members receive:
  • All recent and archived articles
  • Conference offers and updates
  • A full menu of enewsletter options
  • Web seminars, white papers, ebooks

Don't have an account? Register for Free Unlimited Access