Case Study: Enterprise data lake on cloud

1CloudHub helped India’s leading television entertainment network bring its scattered big data into a single source of truth, to make advanced analytics affordable.

Industry

Media

Offering

Cloud Advisory Services

Workload

DC, Servers & Data

Cloud

AWS

Project scope

— Data lake architecture design
— Data transformation and storage in data lake
— Customized reports in PowerBI

About the client

The client is a leading media production and broadcasting company, subsidiary of a global media conglomerate. They have over 30 television channels, a digital business and a movie production business, reaching over 700 million viewers in India.

Business challenge

As part of their digital strategy, our client wanted to optimise user experience across channels — iOS and Android apps, Fire TV, web, and so on — based on user behaviour and preferences. This required a deeper understanding of customer behavioural patterns across platforms.

Presently, they were using Segment as the tool to collect around 6.5 billion records (20TB of raw data) of behavioural data from their 30 million online viewers every month from across sources.

In order to deliver a user-focussed digital viewing experience, the client needed

  • Reliable storage, with protection against data corruption and other types of data losses
  • Security against un-authorized data access
  • Ease of finding a single record in billions (by efficiently indexing data)
  • An advanced analytics engine that can help them derive and visualise meaningful insights from the client’s high volume and variety of data.
  • All of this forming their single source of truth.

Solution

We, at 1CloudHub, enabled an enterprise data lake for all of the client’s data to reside in one place — preserving accuracy and timeliness of the data.

Leveraging our client’s existing mechanism to collect and feed data into the data lake, we created a pipeline with EMR (Elastic MapReduce) for data crunching or ETL (Extract, Transform, Load) and Power BI for self-service visualisation.

Our approach

Understand

Define

Design

Transform

Completion and reporting

01. Understand

  • In collaboration with the client’s development team, we outlined the volume, velocity, veracity and variety of data.

02. Define

  • We worked with the client’s business teams and domain experts to define reports in Power BI for the 18 use cases the client had identified.

03. Design

  • We mapped data to corresponding reports and planned data transformation.
  • Based on these, we designed and architected the data lake and pipeline necessary for Power BI.
  • With the client’s sign-off, we deployed the solution on AWS cloud.

04. Transform

  • Once the infrastructure was in place, our data engineering team performed the necessary ETL steps such as cleaning and consolidation to derive value from the raw data.
  • We stored this in an S3 bucket as parquet formatted files.
  • We imported transformed data as data-marts into AWS Redshift, to be used for Power BI reports.

05. Completion and reporting

  • We delivered a summary of findings and recommendations for production deployment to bring the PoC to a meaningful closure.

Outcomes

Better

Better

We enabled advanced analytics for data from up to a year — compared to the 3 months data as per agreement — to deliver the meaningful insights the business teams sought.

Faster

Faster

We crunched over 12 million records in under an hour, running more than 100 VMs concurrently in a cluster.

Cheaper

Cheaper

We delivered each report at a cost of $70. At this cost, we delivered an excellent price-to-performance ratio, driven by the spot fleet instances we used and our on-demand or pay-as-you-use cloud model.

A similar setup on-premise in a data centre would have cost the client 12,000 times more.

Looking forward

We are delighted to have helped the client create a centralized, analytics-ready repository for their Big Data and look forward to helping them meet their strategic goals using our cloud capabilities.

Latest case studies

Elevating Frontline Operations: Leveraging AI for Efficiency and Customer Delight

Industry Airport management and operations Offering Conversational AI ImplementationGenerative AIAWSPublished OnAugust 19, 2024 About the client A world-renowned airport serving as a major international hub handles over 68 million passengers annually. Renowned for its exceptional service, state-of-the-art facilities, and innovative passenger experiences, the airport is committed to continuous improvement. The organization focuses on expanding infrastructure,[...]

Revolutionizing Email Communication: Intelligent Email Generation with Generative AI

Industry Business Process Outsourcing (BPO) and Customer Management SolutionsOffering Intelligent Email GenerationGenerative AIAWSPublished OnAugust 19, 2024 About the client A leading BPO provider with a strong foothold in the Philippines has been delivering top-tier customer management solutions and innovative business process outsourcing services for over two decades. The company offers a wide spectrum of highly[...]

Implementing Automated Document Comparison Systems in Financial Services

Industry Financial ServicesOffering Intelligent Document ProcessingGenerative AIAWSPublished OnAugust 19, 2024 About the client Fivestar, a prominent financial services firm serving a wide range of clients, faces notable challenges in managing documents efficiently. The company encounters difficulties particularly when dealing with a combination of handwritten and digital documents. These challenges include inaccuracies in data entry, prolonged[...]

Revolutionizing Customer Support with AI: Intelligent Chatbot Implementation

Industry TelecommunicationOffering Intelligent Chatbot ImplementationGenerative AIAWSPublished OnAugust 19, 2024 About the client A leading telecommunications carrier with a massive customer base has selected 1CloudHub as its strategic partner to enhance customer service capabilities. As part of its digital transformation journey, the carrier seeks to implement advanced AI-driven customer support solutions. The primary challenge is managing[...]

Modernization of Document Management System

Industry Financial ServicesOffering Cloud-Driven ModernizationCloud AWSPublished OnDecember 30, 2023 About the client Chola Financial Services, a leading financial institution with a widespread network of branches across India, embarked on a transformative journey to modernize its Document Management System (DMS), GENEX. Teaming up with 1CloudHub, the aim was to migrate GENEX to Amazon Web Services (AWS),[...]

Containerization and Migration of EC2 Applications to Amazon EKS

Industry Financial ServicesOffering EKS MigrationCloud AWSPublished OnDecember 30, 2023 About the client Validus, a leading Singaporean Fintech company, offers a one-stop SME business finance platform specializing in secure local and overseas money transfers. Requirements Validus recognized the benefits of containerization and chose Elastic Kubernetes Service (EKS) for a modernized architecture. The project with 1CloudHub aimed[...]

Elevating Financial Operations with AWS Migration

Industry Financial ServicesOffering MigrationCloud AWSPublished OnDecember 30, 2023 About the client Five Star Business Finance is exploring options on AWS cloud as part of the data centre exit strategy. They currently have challenges of scale and availability. This is due to lack of app environment segregation (Non-Prod and Prod), and co-hosting of multiple applications on[...]

Banking Infrastructure Migration to AWS: Achieving Scalability, Security, and Efficiency with 1CloudHub

Industry Financial ServicesOffering Cloud MigrationCloud AWSPublished OnDecember 30, 2023 About the client Orange Retail Finance India Pvt Ltd, a leading non-banking finance company certified by the Reserve Bank of India, sought to modernize its operations by migrating its on-premise infrastructure to the cloud. Requirements Orange Retail Finance needed to migrate critical banking applications to AWS,[...]

Enhancing E-Commerce Platforms with Image Processing Capabilities

Explore a successful e-commerce transformation with AWS and 1CloudHub. Learn how AWS Lambda-powered image processing optimizes scalability, reduces costs, and accelerates time-to-market.

Migrate and Modernize the MSSQL on RDS to PostgreSQL on Aurora (Babelfish) Using DMS

We helped to Migrate and Modernize the MSSQL on RDS to PostgreSQL on Aurora (Babelfish) Using DMS

Migrate from DB on Amazon EC2 to Amazon RDS for MySQL with HA using AWS DMS for Nalli E-Commerce Platform 

We helped our top E-commerce platform customer to Migrate from DB on Amazon EC2 to Amazon RDS for MySQL with HA using AWS DMS

Migrate from MySQL on Amazon EC2 to Amazon RDS for MySQL

We helped our top customer in migrating from MySQL on Amazon EC2 to Amazon RDS for MySQL  

DB Modernization MS SQL on RDS > PostgreSQL on Aurora

We helped our top customer in DB Modernization MS SQL on RDS > PostgreSQL on Aurora

AWS Well-Architected Review For A Retail NBFC

1CloudHub helped a top Retail NBFC by conducting Well-Architected Review For Their Applications

Cost effective, Scalable Cloud Solution for connected vehicle telematics

1CloudHub helped the automotive manufacturer with a Cost-effective, Scalable Cloud Solution for Connected vehicle telematics

Migrating LOB workloads for NBFC

1CloudHub helped a leading Investment and Finance Company in Migration.

E-Commerce Platform Migration to AWS Cloud

1CloudHub helped an Indian wardrobe store and silk saree emporium in migration

Application Modernization and Migration of Enterprise Workloads

1CloudHub helped a leading global shipping giant to organize shadow IT systems and bring in centralized governance.

Financial Services – Application Modernization to enhance agility & scalability

1CloudHub helped a Investment and Finance Company Limited in India in DevOps Implementation.

Winning the DevOps Way

1CloudHub helped a leading assessment and learning product firm in DevOps Implementation.

Application and Database Modernization along with CI/CD

1CloudHub helped the third largest Shipping and transportation company in DevOps Implementation.

Using DevOps To Keep An Edge

1CloudHub helped an Indian wardrobe store and silk saree emporium in DevOps Implementation.

Migration of large Windows landscape from On-prem Data center to AWS

Windows Workload Migration from On-Prem to AWS with Zero Down Time

Migration of e-Commerce portal from On-prem Data Center to AWS

1CloudHub helped the online shopping store in migrating from on-premises to AWS, reducing downtime and ensuring end-user security.

DevOps Implementation- Automated Deployment Process

Migrated the entire IT infrastructure – ERP & Financial systems – from OnPrem to Cloud without impacting the business which needs the systems to be running 24 x 7

Data Lake on AWS For Seats and Revenue Analytics

Data lake was successfully created by ingesting data from various sources which enabled the customer to perform seat and revenue analysis

IaC Automation & Data Generation

We at 1CloudHub successfully containerized an identified application, optimizing the cloud resources used by the application, for continuous delivery.

Migration of IT Infrastructure from OnPrem to Google Cloud

Migrated the entire IT infrastructure – ERP & Financial systems – from OnPrem to Cloud without impacting the business which needs the systems to be running 24 x 7

Leveraging AI/ML(Personalization) to Increase Checkout Ratio & Rationalize Discount Coupons for a leading B2C E-Ticketing Platform

Increase in Checkout Ratio by 2 basis points Decrease in cost to business by categorizing into 6 categories

App Cloud Maturity Enhancement (Using Containers)​

We at 1CloudHub successfully containerized an identified application, optimizing the cloud resources used by the application, for continuous delivery.

Pro-Active 24×7 Managed Services

1CloudHub manages IT assets for India’s largest and no. 1 stem banking company to support their business continuity 

CI/CD Application Deployment Process using Serverless Technology

1CloudHub helped building CI/CD pipelines for 20+ active and critical applications.

Knowledge Portal on AWS for a Leading Corporate Compliance in India​

We helped one of the largest Corporate Compliance in India to create knowledge portal on AWS, cost effectively.

Migration of E-commerce Portal from OnPrem to AWS Cloud

Seamlessly migrated 10+ VMs to AWS with zero downtime. 5% savings on Infra spend by Right sizing and cost optimization​

Migration of DNB platform for SMEs from an existing hyper cloud platform to Azure

Seamlessly migrated the DNB platform from an existing hyper cloud platform to Azure to support a transaction of INR 75 Cr every day

Personalize fitment to determine AI/ML driven Solution Roadmap for a leading ​ B2C E-Ticketing Platform​

1CloudHub helped one of India’s largest online e-ticketing company in Data Acquisition, Data Validation, Fitment to Personalize services and Roadmap with future insights.

SIFT Customer Engagement Platform on Cloud

We envisioned, designed and implemented cloud transformation strategy for APAC’s largest Customer Engagement Product company  in a span of 4 weeks. We look forward to working with the client again on more cloud transformation projects that will help them achieve their business goals.

Digital Asset Management Platform​

We helped one of the pre-school in India to build a Digital Asset Management platform which enable the organization to manage video files by tagging the assets based on their metadata for efficient search and retrieval.

DataLake and Analytics for Digital Exam Platform on AWS

We were able to unify multi source(including on-premise) data sets, created future proof analytical platform for delivering a  hierarchical student performance reports.

SAP S/4 HANA Functional Enhancement & Implementation

We are glad to have played a key enabling role in helping customer to build a pricing functionality within SAP S/4 to move away from excel/manual pricing process for accurate and real-time business reporting

Case Study : Migration of popular news sites to Cloud with Zero Downtime

We at 1CloudHub successfully migrated one of India’s established news site to cloud seamlessly while optimizing the infra for cost and performance.

Case Study : Hospital Information System (HIS) set-up on Cloud

We helped one of India’s largest Health care provider, to set up their HIS application​ in a short period of 3 weeks

Case Study: SAP ECC Migration on Azure Cloud for a Health Care Manufacturer

Fast tracked On-Premise SAP ECC Dev, QA & Prod Landscapes to Azure while ensuring a smooth cutover within an hour.

Case Study : SAP S/4 HANA Greenfield Infra Implementation

We helped one of the largest security service company in Singapore to adopt their first cloud application (SAP S/4 HANA) in Azure cloud

Case Study: Big Data on Cloud

1CloudHub helped one of the world’s largest manufacturers of commercial vehicles deploy a cost-effective, scalable cloud solution for their Big Data.

Case Study: DR for geographically diverse SAP

We helped one of the world’s largest paper, pulp, and packaging companies, a first-time cloud adaptor, to establish a unified DR site.

Case Study: RPA on cloud

We helped a global shipping leader achieve on-demand scaling through a multi-geography accessible RPA solution.

Case Study: Multi-cloud strategy

We helped India’s leading integrated healthcare delivery service provider design and implement their HIS on cloud.

Case Study: Enterprise app migration

We helped a global leader in supply chain services efficiently and effectively host their applications on the cloud during a period of business transformation.

Case Study: DC backup and DR

We helped India’s leading television entertainment network architect, deploy, and manage their data backup system.

Case Study: SAP on cloud

We helped one of the world’s largest shipping companies increase the future load-capacity of their mission-critical SAP CRM, at significantly lower costs.

Case Study: DC and app migration

We envisioned, designed and implemented an end-to-end cloud transformation strategy for a leading gaming company in Malaysia.

Sharing is caring!

Subscribe to our Newsletter1CloudHub