Setup of Data Lake and MDM Framework

  • May 17, 2023
  • Girikon
Background

The Client is one of the largest event management companies with a global presence. The company organizes Exhibitions & Conferences that connect groups interested in developing commercial relationships while expanding their business. With the global competitive market, several acquisitions & many external data sources had been the key drivers behind the client’s (a global event management company) decision to manage better, centralize & utilize their core information to achieve their long-term strategic goals​. The Client partnered with Girikon – a reputed Salesforce consultant to well manage their data.

The Problem

The following challenges were identified:

  • Globalization, mergers & acquisitions, etc. was creating the earnest need to have consistent data, synchronized across the enterprise.
  • Regulatory compliance needed the data to be tagged with all peripheral enablers (policies, definitions, domain, business rules, metadata, quality, governance, ownership, security, etc.)
  • Better performance & business analytics required accurate, consistent & reliable data

All this drove towards building the strategy for an Enterprise-wide MDM, centralizing Data Lake/Hub & creating focused Data Marts enabling better-synchronized data, consolidation of all transactional data, and effective analytics for intelligent decision making.

The solution
  • Building a customized MDM (Master Data Management) to host all enterprise-wide master data & related rules for governance using Talend and MySQL DB.
  • Creation of PostgreSQL Data Hub (AWS), in a hub-and-spoke architecture with defined processes for consolidation of transactional data across several user-facing systems
  • Development of focused Data Marts for feeding different enterprise-wide systems & reporting platforms
  • Use of Mulesoft as the middleware for all integrations
  • Use of Talend as the ETL tool
  • Migrate transactional legacy Data (e.g., registration details, opportunities etc.)
  • Extensive brainstorming to include the right mix of key Master Data elements in the eco-system amongst Customer-Centric, Enterprise – Centric & Supply Centric elements so as to strike a balance between ease/complexity of overall processes, decrease in technical debt & ROI
The Outcome

The initiative eventually resulted in the standardization of the processes in which the organization stored, managed, viewed & used its data. To summarize, the benefits were multi-faceted including the following:

  • Centralized view of all the Data​
  • Single view of the customer​
  • Targeted marketing conversions ​
  • Better customer insight and interactions to provide customized services​
  • Ability to recognize cross-sell and up-sell opportunities​
  • Empower front-line sales, service, operational, supply chain, and other staff with information that can improve business performance.
  • Greater customer loyalty
  • Better sales efficiency
  • Better IT efficiency & increased security
Share this post on: