Welcome!

Government Cloud Authors: Elizabeth White, Pat Romanski, Dana Gardner, Liz McMillan, Gopala Krishna Behara

Related Topics: Containers Expo Blog, Microservices Expo, Government Cloud

Containers Expo Blog: Article

Why Federal Government IT Leaders Like Data Virtualization

Better data integration is key to effective governance

With money tighter than ever, federal agencies are under increasing pressure to improve efficiency, share information more readily and execute on ever-expanding congressional mandates.

But this is far easier said than done in IT environments with government-sized volumes, decades of existing systems and myriad new requirements being layered on top.

Is there a better way to for federal government IT leaders to meet these challenges?

There is.  It is called data virtualization.

Step 1 - Align with Service-Oriented Architecture Mandates
Recognizing the need for high-level, cross-agency direction for addressing these challenges, the federal government wisely identified a number of top-down service-oriented architecture (SOA) initiatives including Netcentricity, Civilian Centered Services, e-Government and more.

These broad strategies address system integration, i.e., the leveraging and advancement of already running systems, in an intelligent, yet high-level way. They do not proscribe the detailed implementations however. So agencies have the freedom, or curse, to identify specific technological implementations and vendors.

Step 2 - Simplify the Problem to Accelerate the Solution
Most new development leverages existing transactional processing and information reporting systems. Each is very different by its nature. And so too are the tools, techniques, and most important staff who develop and support them.

Consider data integration. How many ways are there to integrate data?

  • Hand code direct, point-to-point integrations
  • FTP files from one system to another
  • Replicate data from one database to another
  • Consolidate data in a warehouse or mart using ETL
  • Query data on demand using data virtualization

Especially well suited for SOA style architectures, data virtualization is the newest approach, emerging from earlier technologies such as enterprise information integration (EII) or federated query.  And at this point, Gartner, Forrester, and TDWI all recommend that organization have all these options at their disposal; selecting one or more on an application-by-application basis.

Step 3 - Try Data Virtualization
Numerous government agencies, across civilian, defense and intelligence, are already using data virtualization today to provide the diverse, distributed information required in support of a range of mission-critical IT projects.

Data virtualization is often a critical success factor in a federal agency's ability to be agile and cost-effective when integrating the key information required to its customers - citizens, industry, and other agencies or departments. Significant benefits include:

  • Increased Responsiveness - Accelerate time-to-solution for new information requirements
  • Improved Productivity - Ensure civilian, military, and intelligence staff can access all the information they require
  • Reduced Costs - Avoid long data integration development cycles and excess data replication
  • Decreased Risk - Provide complete visibility across agencies
  • Better Compliance - Meet FEA and SOA information standards

Data Virtualization Supports SOA
New service-oriented approaches including XML structures, the XQuery language, SOAP, REST, JMS and more have greatly complicated data integration in the past five years. Gone are the days when the SQL language and relational structures alone could support nearly all an agencies' information reporting needs.

Simply wrapping existing data sources doesn't scale.  And applying ESB and other transaction-centric integration approaches is an awkward way to meet more complex data-centric services needs where data modeling and query optimization are critical capabilities.

Data virtualization platforms, such as the Composite Data Virtualization Platform, provide a complete set of development and runtime tools to build and deploy sharable data services that meet a variety of agency information needs.

Delivering data to consuming applications via SOAP, JMS and REST, data services can be applied to multiple projects, so government IT leaders can achieve their agility and reuse objectives. Data virtualization platforms even allow agencies to repurpose "non-SOA" code such as relational views into sharable data service in just a few clicks.

And because data virtualization platforms work in conjunction with other SOA tools such as Enterprise Services Buses (ESBs), Registries, and Application Servers, agencies can leverage existing technology investments, even those obtained for transactional integration focused applications.

Data Virtualization Supports the Federal Enterprise Architecture (FEA) Model
According to the FEA Program Management Office, "Federated Data Management is an architecture for managing and accessing information data and metadata across physical boundaries, which may be system to system, department to department, or enterprise to enterprise boundaries."

Data services built and deployed using data virtualization are key enablers for the following FEA components:

  • Service Component Reference Model
  • Technical Reference Model
  • Data Reference Model

How Data Virtualization Enables Cross-agency Data Sharing
Data virtualization can help the government share data held in disparate IT systems and groups, presenting the information to multiple agency applications in a uniform fashion.  For example, government agencies can virtually gather and share data concerning the experimentation and distribution of hazardous substances from the Centers for Disease Control, U.S. Department of Agriculture, federally funded university projects, and more.

How Data Virtualization Simplifies Website Development
To provide the website, government agencies and citizens require, data virtualization can simplify the process of turning disparate source data into easy-to-consume data for internal and external web portals. For example, a Department of the Interior agency can combine disparate systems to provide citizens with comprehensive view of park attendance, weather reports, upcoming park activities, and more.

How Data Virtualization Delivers a Single View of a "Person of Interest"
Today, several defense and intelligence agencies use data virtualization to gain real-time or near real-time access to data across multiple underlying systems. Rather than discuss specifics, consider how such a capability might allow the U.S. Department of Homeland Security to pull seemingly innocuous information from multiple partners throughout the intelligence community, Transportation Security Administration, Customs and Border Protection, and Immigrations and Customs Enforcement, to effectively profile persons of interest.

How Data Virtualization Improves Operations
By providing on-demand capture and analysis of operational data, data virtualization helps government agencies make better decisions and improve operations.  For example, agencies may be overpaying of disaster claims.  Data virtualization can simplify on-demand access and integration of claims and payment systems giving agencies greater visibility into fraudulent cases, while avoiding expired claims.

Step 4 - Get Started on the Data Virtualization Path
The heat is on. New data integration approaches are needed.  Now is the time for government IT leaders to consider data virtualization.

Fortunately the path to successful data virtualization adoption is well understood, with a number of proven tools readily available including:

More Stories By Robert Eve

Robert Eve is the EVP of Marketing at Composite Software, the data virtualization gold standard and co-author of Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility. Bob's experience includes executive level roles at leading enterprise software companies such as Mercury Interactive, PeopleSoft, and Oracle. Bob holds a Masters of Science from the Massachusetts Institute of Technology and a Bachelor of Science from the University of California at Berkeley.

IoT & Smart Cities Stories
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
All in Mobile is a place where we continually maximize their impact by fostering understanding, empathy, insights, creativity and joy. They believe that a truly useful and desirable mobile app doesn't need the brightest idea or the most advanced technology. A great product begins with understanding people. It's easy to think that customers will love your app, but can you justify it? They make sure your final app is something that users truly want and need. The only way to do this is by ...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
Cell networks have the advantage of long-range communications, reaching an estimated 90% of the world. But cell networks such as 2G, 3G and LTE consume lots of power and were designed for connecting people. They are not optimized for low- or battery-powered devices or for IoT applications with infrequently transmitted data. Cell IoT modules that support narrow-band IoT and 4G cell networks will enable cell connectivity, device management, and app enablement for low-power wide-area network IoT. B...
The hierarchical architecture that distributes "compute" within the network specially at the edge can enable new services by harnessing emerging technologies. But Edge-Compute comes at increased cost that needs to be managed and potentially augmented by creative architecture solutions as there will always a catching-up with the capacity demands. Processing power in smartphones has enhanced YoY and there is increasingly spare compute capacity that can be potentially pooled. Uber has successfully ...
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...