Getting data silos under control

 

Connecting state and local government leaders

Master data management is an emerging technique for organizing silos of information. But it's only part of the solution ' agencies still need efficient guiding principles for handling their data.

A prospective employee walks onto a job site and applies for a job. How much will that employer know about the applicant?Under immigration reform legislation, a stipulation called the Employment Eligibility Verification System would mandate that employers check the eligibility of all current or potential employees against federal and state databases.Potentially, information, or lack of information, about this person could be found in databases managed by the Social Security Administration, Homeland Security Department, Internal Revenue Service and perhaps even the FBI.But isn't the problem with data, which prompted post-Sept. 11 criticism, that one database doesn't know what's in the other database?The integration of data within a federal agency and sharing it among various agencies is a long-standing problem. Master data management, or MDM, is one response.'The panacea of MDM is to identify the true single source of the truth for the data and to use that one source as the source for all applications and programs,' said Brad Cole, a solution architect manager at Oracle.And the seemingly simple task of identifying this single source of truth can have profound effects ' if done correctly.'Until recently, most government agencies were more focused on building a data warehouse and reporting against that data warehouse,' said Mike Protz, director of U.S. government support at SAS Institute. 'Now they are moving beyond basic warehousing and reporting and focusing more on the advantages of MDM as an enterprise strategy. With the growth of service-oriented architecture and systems integration, MDM has garnered more attention.'Managing data silos, a subject familiar to government managers, is the end game of MDM. Putting the concept in motion can be overwhelming, however. Steadily, vendors and consultants see it as a new opportunity. Yet others see MDM as hype and today's way of capitalizing on an age-old problem.[IMGCAP(2)] 'MDM, although known by various monikers before the buzzword came into use, has been around for years and is another step in the evolution of 'getting control' of all the stovepipes and legacy-system data that exists in federal agencies' systems' said Tom Kyte, vice president of public sector strategic sales support at Oracle.Dr. Peter Aiken, an associate professor and researcher at Virginia Commonwealth University's information systems department, conducted research about data's role in the enterprise, and said that data problems are nothing new.'There's lots of guidance out there for MDM that is just plain wrong,' Aiken said. 'MDM doesn't solve your problems. Good guiding principles do.'Nevertheless, with Microsoft's recent acquisition of pioneering MDM company Stratature, it seems that many vendors want to get a piece of this emerging niche within government information technology.'Everyone is a player,' said Lance Osborne, marketing leader at CDI Solutions, which provides consulting and implementation services for data integration and MDM. 'Oracle, SAP and IBM are at the top of most analysts' lists. Other big vendors are sniffing at the door, including Microsoft and [Hewlett-Packard]. There are also major players on the systems integrator and consulting side of this trend, including Accenture and BearingPoint.'At the moment, deploying MDM is not synonymous with deploying a specific technology. It begins with a good understanding and definition of who owns the data, and who is to see and use that data. It requires a process-centric solution of defining the 'master' source and then identifying the other systems that rely on that data. Once ownership is set and controlled, technology tools enter the picture to enable the ownership and sharing of data.'The idea is that MDM is the method by which you have clean, accurate consistent data synchronized across an enterprise,' said Bill Cooper, vice president of data warehousing at Teradata.Cooper said he has seen wildly diverging answers to seemingly simple questions, such as the amount of a particular invoice or how many flying hours a military pilot logged. In many cases, you will get different values for the same thing, depending on which system you query. 'If you don't have clean, consistent data across the enterprise, your ability to manage and report on the data is limited,' he said.[IMGCAP(1)] MDM relies on standardization, governance, techniques, tools and a technology platform that addresses the issue of data usage, security and quality, said Bill Kirkendale, chief information officer at the District of Columbia's Court Services and Offender Supervision Agency (CSOSA). Done correctly, it can provide seamless interoperability, data exchange, and transactional and analytical integrity.For the CSOSA office, the importance of MDM came into focus when it embarked on building an enterprise data warehouse to consolidate material about offender supervision and treatment, which was held in multiple databases, Kirkendale said.One of the biggest worries was balancing the privacy of individuals in the system against the distribution of data that would be valuable for maintaining the public safety.Compiling data in an enterprise data warehouse could present a headache for program managers. There are many policies and laws concerning the safeguarding of personnel data that agencies such as CSOSA must adhere to. When used in only one system, the program manager can assure that use of that data meets the appropriate guidelines. Once that data is distributed, though, control gets a lot more difficult.'I need a traffic cop, an arbitrator and an adjudicator to make decisions in real time,' Kirkendale said. 'The decisions must be informed and they must be informed based on today's conditions, not the conditions that were.'Having MDM in place and overseeing the data can simplify this task immeasurably.Aiken said MDM is being sold at the chief information officer level but needs to be embraced at the operating level. Before you throw money at a vendor's technology solution, take a good look at your data architecture. Embracing MDM before you look at your architecture, Aiken said, is like trying to put 'old wine in new bottles.'Aiken likens successful use of MDM to solving a jigsaw puzzle. You begin by gathering the edge pieces, grouping them and understanding the structure that results. Once you understand your data architecture, only then should you sign a contract for MDM software.This task is not simple, however, especially because the data can be shared across other offices within the agency or with other agencies altogether.'Most agencies have done this to a large extent within their own boundaries and are now attacking the challenge of mastering data that is shared among multiple agencies,' Aiken said. Many agencies are investing in the physical tools to share information across boundaries, such as data warehouses. This reuse of data in new circumstances leads to all sorts of new questions about the meaning of the data.'Federal agencies have been putting together their data for quite some time to make it accessible and understandable from many perspectives and/or dimensions,' Kirkendale said. 'In the most recent years ' with the Congress and the administration's focus on accountability and performance ' special attention has been placed on the organizational, programmatic, human resource and financial interpretive power of the data.'Kirkendale said he believes that MDM is a fundamental building block of enterprise architecture, and that getting the architecture right needs to come from the top down.'Though mandated, it is finally sinking in and moving beyond its compliance-purposed adolescence,' Kirkendale said of enterprise architecture.'The dots need to be connected and the language common ' bring the EA and the enterprise data warehouse folks together,' Kirkendale said. 'Give them a side task: Do MDM.'

Three pillars of organizational data

To understand what master data management is, you need to understand the three types of organizational data, according to an Oracle white paper published last December:

Transactional Data is generated during the actual operation of the organization. The Internal Revenue Service, for instance, could count the data on the tax forms it receives as transactional data. Such data is usually stored in online transaction processing tables, which are designed to be updated frequently.

Master Data covers all the entities, such as individuals, products or regulations that initiate or are otherwise involved in the organization's transactions. They can be people, companies, assets or even regulations. They can be, and usually are, referenced in more than one system in the organization.

Analytical Data can be used to produce reports and generally help organizations make decisions. The IRS, for instance, can produce reports on how much tax money was collected or how many returns were filed. This type of data tends to be stored in data warehouses or data marts, which support heavy aggregation and data mining.

Because master data elements are used across different systems, they must be represented with consistency so that the analytical information that is produced from transactions can be tallied and analyzed with accuracy. For a copy of the white paper, go to GCN.com/818.

ON TRACK: The District of Columbia's Bill Kirkendale says master data management helped streamline development of a data warehouse to track criminal offender supervision and treatment.

GCN Photo by Zaid Hamid

'MDM ' is another step in the evolution of 'getting control' of all the stovepipes and legacy-system data that exists in federal agencies' systems' ' Tom Kyte, Oracle

GCN Photo by Olivier Douliery





























Practice, practice



















Taste the wine

















Jim Romeo is a freelance writer based in Chesapeake, Va.

GCN assistant managing editor Joab Jackson contributed to this article.

NEXT STORY: The incredible shrinking modem

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.