This article introduces the concept of semantic enterprise and outlines a connection between semantic enterprise and master data management (MDM) concepts. The article also shows that successful transitioning to semantic enterprise requires significant improvements in enterprise metadata and especially in business metadata management. It explains the importance of supporting an enterprise-level semantic continuum from both business and IT communities by committing to development of enterprise architecture tenets that would bring both communities to a more synergetic environment.
Once broadly realized, the critical and indispensable nature of the relationship between business, information and technology architectures will generate demand for improvements to modeling tools that vendors will have to meet in order to remain relevant.
Master Data Management and Metadata
Currently, most tool vendors define MDM as the capability to create and maintain a single, authoritative physical source of master data. The purpose of this source is to make shared data data that has a single content and format available to all the enterprise systems that need to reference it. As such, master data is typically called reference data.1 (Some authors differentiate between reference and master data.)
While MDM, by this definition, is an important technical pursuit in its own right, there is a larger phenomenon behind it.
The broader issue is the semantic integrity of shared data (or rather, the lack of it), particularly at the enterprise level. Lack of what Gartner calls semantic reconciliation among data from different sources is inherent in a diverse, dynamic and autonomous organization. Resolving discrepancies in metadata descriptions from multiple tools, not to mention cultural and historical differences, involves more than physically consolidating metadata into a common repository.2
In other words, it is always possible, and arguably, quite easy, to misinterpret any shared data in the absence of rich contextual information that unambiguously distinguishes between different possible meanings. A substantial portion of this rich metadata context should come from information about the business processes that generate and use the shared data. While this metadata continuum starts in the business function model layer, it should support a consistent interpretation of shared metadata that continues through the complete business-IT space, all the way through to the implementation and maintenance of the deployed applications and services.
Consider a scenario where marketing, sales, and customer service departments all use the enterprise current customers set. In order for any enterprise to produce reconcilable financial and managerial reports, it is imperative that when systems from different departments access the same data from a single source, their interpretation of what constitutes current customers should also be identical. In the case of historically different definitions embedded in legacy systems, each department should be aware of which particular definition has been used for the enterprise master data and how to correlate that definition with its own departmental definition of current customer. The following architectural model helps to minimize probability of errors.
Three-Layered Architectural Model
A simple enterprise architecture model that supports the desired metadata layering is shown in Figure 1.3 This model links all three layers: business function, system specification and physical/implementation, into one enterprise metadata continuum, in order to guarantee information integrity for the whole enterprise.
All constituents that populate enterprise architecture models can be grouped into four architectural domains: business, information, application and infrastructure.4 Notice that according to the proposed partitioning, data architecture does not constitute its own domain but is actually a subdomain of information architecture.
Management of metadata information that describes the physical (infrastructure) layer is a challenging problem in its own right. However, this topic is well outside of this articles scope and is extensively covered by the ITIL and numerous other publications on Configuration Management Database (CMDB). For those interested in a detailed discussion of the enterprise infrastructure metadata topic, please see Charles Betzs Architecture and Patterns for IT Service Management, Resource Planning, and Governance: Making Shoes for the Cobbler's Children.5
For the purpose of this discussion, I will concentrate on the business function layer. A business function is a particular proficiency that an organization - typically an enterprise - possesses and operates to achieve a specific business goal. A business function is an abstraction of a business process that preserves the main characteristics of what is being delivered by the process, discarding most of the information about how it is done, and thus representing an externally visible view of the business process.
The foundational nature of the business-function layer definitions need to be emphasized. Unless all applications that reference master data elements agree on the exact meaning of all shared information structures, within the appropriate business process context (e.g., customer, current customer, returning customer, high-value customer, etc.), there is very little practical value in creating shared physical data stores.
Unfortunately, the generation of business-function layer metadata, its maintenance and integration with metadata from other layers, presents a number of issues.
Business Function Layer and its Metadata
Despite ongoing discussion about the need to add more explicit business function-level, technology-independent contextual information to the metadata repositories, there are currently only very few tools that offers such capabilities (Id be happy to learn that I am wrong here). One of the reasons that integration of business function-level metadata across all architectural layers is so difficult to achieve is that the standards for the metadata representation in each of the model layers are still emerging, especially in the top-most business function layer.
Recent progress by modeling tools vendors and the user community around the BPEL, XMI, CWM, and other standards positioned to answer the need for exchanging and storing metadata is very promising.
However, the integration and unification of different types of modeling tools, as it was predicted in 2005 by Michael J. Blechar of Gartner, is far from being complete. Before disparate modeling tools from the same or different vendors can truly become integrated, standards such as UML and BPMN must evolve and be coordinated. Gartner does not expect this effort to be completed - or, at least, approach a good enough solution to integrate best-of breed tools in any meaningful way - until 2007 or 2008.6
While integration of modeling tools is definitely a serious problem, the main problem faced by most companies is the absence of realization that a common understanding of information between the different constituencies of the modern enterprise, both external and internal, is needed. The common semantic enterprise space should extend in both directions: horizontal and vertical. The horizontal dimension addresses the interactions between different departments of the same company as well as between a particular business entity and its external environment (i.e., business partners, suppliers, legal and regulatory compliance mandates, consumers, etc.). The vertical dimension addresses the information interchange between business users looking for productivity improvements and cost reductions on the one hand, and the IT community responsible for implementation of the required automated information systems on the other. Due to the extremely complex nature of the modern IT environments and the specialization that is caused by this complexity, further specialization in skill sets and fragmentation in the IT semantic space needs to be addressed as well. One possible solution here is the creation of an organizational role at each level (business function, logical specification and physical implementation) that is responsible for each layers, and interlayer semantic integrity. For example, business process models created by the business process architects and the information models created by information architects should have referential integrity. For this wonderful, if not miraculous, event to finally take place, these models need to share a common semantic space (i.e., every information element and information structure that exists in the information models should be referenced in the process models and have identical meaning in all of them). The corollary is also true: no two different information elements can have the same meaning in all business process models within the scope of a single business unit domain. In addition to that, the existence of information elements (in information models) that are not used in any of the business process models is, in general, disallowed.
Semantic Enterprise and Semantic Web
The concept of enterprise semantic space (or semantic enterprise) is closely related to that of semantic web. While there are significant similarities between the two, there are also some significant differences.
The main similarity between the two concepts is a notion of well-defined information meaning (or semantics), which ensures that complex information management processes are successfully executed in a predictable manner. Both concepts require well-structured information models (a.k.a. ontologies) as well as tools that process these rich information models in order to establish and maintain common understanding of information between the different parties involved in exchanging information. At the implementation level, it is safe to assume that UML- and XML-based technologies (MOF, XMI, RDF, etc.) would play the central role in the development of both concepts.
At the same time, the main difference is rooted in the degree of centralization, or rather decentralization. While the creators of the semantic web presume a highly decentralized model with a relatively high degree of inconsistency, the semantic enterprise is significantly more sensitive to semantic inconsistency and thus would require a higher degree of centralization and control.
While detailed discussion of the semantic Web is beyond the scope of this article, it is important to understand that these two concepts have significant overlap and would probably develop a common set of tools and approaches.
Unifying Data - and Process - Centric Views on Metadata
From the enterprise metadata point of view, MDM, in a broad sense, is a sign of things to come. It highlights the existing need for a new approach to the integration of business function-level metadata at the Enterprise level or Enterprise Business Metadata Integration (EBMI). I would prefer to use the term enterprise information integration (EII), but unfortunately this term is already used to describe a virtual integrated data view centered on the physical implementation layer. The term EBMI describes a consistently coordinated (unified) view of the business function-level information at the Enterprise level. It implies neither a single physical format used by all systems, nor a virtual database that provides access to the information, regardless of its physical location (similar to EII technique). In actuality, EBMI is primarily concerned with conceptual and logical level information, rather than information at the physical implementation level. EBMI implies that there is an agreed upon (by all business and IT constituencies) definition for certain information structures, each within a particular well-defined business function context, as well as a robust translation mechanism between the different formats of metadata used by multiple business and technology counterparts. Any physical implementation that is compliant with the definition above is naturally a part of the solution.
For example, two departments of the same company, order management and fulfillment on one side, and customer service on the other, have historically had different definitions of what constitutes a returning customer, a fulfilled order, an inventory level trigger, etc. The company as a whole may or may not have implemented a single physical data store for this information. While it is highly desirable to factor out common enterprise information and store it in one central location to minimize redundancy, it is not critical. It is, however, absolutely critical for the long-term health of the enterprise to make sure that both departments are aware that they have differences in the customer and order semantics, which are rooted in implementations of the departmental business processes. Another critical component of the solution is a set of rules that correlates (translates) two departmental definitions. The EBMI concept is similar to the business modeling approach provided by business process modeling tool vendors since it presents rich contextual information about business functions that a company possesses in order to meet its business objectives. What makes this concept different from the traditional business process modeling approach is that it adds metadata, which describes the information (data) elements participating in the business processes. By providing a robust information architecture model that complements the business process modeling view, EBMI brings together the business process modeling approach and the data-centric approach (traditionally used by the data modeling and database programmers community).
The examples and issues presented above demonstrate that the effort to establish a semantic enterprise continuum should be driven by both the business and the IT communities. Cooperation of the two communities, and especially the sponsorship of the business leaders, are of primary importance. However, the goal of building a semantic enterprise cannot be accomplished without the necessary tools, even with the two communities working in concert. This is especially true for the interlayer integration while tool vendors have begun to provide a better support for physical layer metadata integration, support is almost nonexistent for cross-layer interactions. Vendors that provide not only horizontal integration capabilities across physical sources (physical sources data lineage) but also vertical integration capabilities between physical data and business process contextual information will emerge victorious in the critical integration race.
- Malcolm Chisholm. Master Data Versus Reference Data. DM Review, Septmber 2006.
- Vickie Farrell. The Need for Active Metadata Integration: The Hard-Boiled Truth. DM Direct, September 2005.
- Microsoft. Quality Data through Enterprise Information Architecture. MSDN Microsoft Developer Network, January 2007.
- Gene Leganza. Creating the Information Architecture Function. Forrester Research, June 2004.
- Charles T. Betz. Architecture and Patterns for IT Service Management, Resource Planning and Governanace: Making Shoes for the Cobblers Children. Morgan Kaufmann: 2006.
- Michael J. Blechar. BPA, Object-Oriented and Data Modeling Tools are Converging. Gartner Research Publication, 2005.
Register or login for access to this item and much more
All Information Management content is archived after seven days.
Community members receive:
- All recent and archived articles
- Conference offers and updates
- A full menu of enewsletter options
- Web seminars, white papers, ebooks
Already have an account? Log In
Don't have an account? Register for Free Unlimited Access