Data & Analytics - Transforming into a value-driven, convergent space - CyberC 2020
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Data & Analytics –
Transforming into a value-driven, convergent space
Anirban Bhattacharya
Practice Head – Data & Analytics – APAC, India (Telecom, Media & Entertainment)
Tech Mahindra
CYBERC SUMMIT 2017
1 I Copyright © 2017 Tech Mahindra. All rights reserved. October 2017 1
Data Explosion – the
peril and the
opportunity
I Copyright © 2017 Tech Mahindra. All rights reserved. 2
Just a minute! 3 I Copyright © 2017 Tech Mahindra. All rights reserved.
That leads us to nothing short of a Data
explosion – the reality of today!
Twitter gets
43 Trillion From Music to medical
records, from traffic on
98,000
Gigabytes of Data
will be created by
2.3 Trillion roads to social media, tweets 600+ videos
Gigabytes of Data is per min are uploaded on YouTube
2020- 300 times
created everyday our world relies on videos per min
from 2005
technology and data- It
Almost all modern has to be stored,
vehicles have analyzed and used.
GPS These data are huge!
> 6 billion
people
enabled And the single term that
tries to encompass it is-
695,000 Google serves more that
have cell phones
Big Data. status updates, 94,445 queries
Stock exchanges capture 79,364 wall posts and 510,040 comments per min
How and what is it?
TBs of data are published on Facebook per min
per session
The type of data
depends from
Organization & industry.
For Telecom network Poor DQ cost
huge loss- US
providers, we can
Millions of Economy lost
CDRs, Top-Ups and Network consider CDRs, Top-Ups, What is the
$3.1
other events are connection
other events, probe probability Trillion
data, NoC, site
generated every minute
per person is going to be
>2 for entire world in
maintenance etc.
that the data is > 80%
correct? a year
2016! Just imaging the
population
4 I Copyright © 2017 Tech Mahindra. All rights reserved.
Where has it led us to?
Digital
Customer
Enormous Experience Unheard-of
Capacity & Process
Storage AI, Machine latency
Automation
Learning
The
data
Content deluge! Technology
Personalization
Transformation
& Management
Extensive Marketing &
IoT, M2M Data
Technology Offerings
knowhow
diversity
5 I Copyright © 2017 Tech Mahindra. All rights reserved.
Big Data – a wide canvas
Big Data challenge triggering wide avenues for opportunity and engagement
Data Driven Transformation through a “Data-First” Culture Vision
Business-critical
Capability enhancement, enabling Data Driven Decisioning Use Cases
Steering up the Valur-Chain
Enabling Predictive and
Define Platform Arch, establish an Analytics Operating Model Prescriptive Analytics
Ensure Data Governance and
Stewardship
A Data Governance approach on the unstructured world
Establishing a Data Infrastructure to enable TCO
Benefits
IOT Analytics, Machine Learning
Transforming Insights to Value: Customer 360
Enable Digital Transformation leveraging Data & Analytics
Build Analytics Roadmap for Organization
6 I Copyright © 2017 Tech Mahindra. All rights reserved.
The value-chain and a diverse set of technologies
Data Ingestion Data Processing & Data Analytics Data Storage Data Reporting
Transformation & Visualization
Data Governance &
Management
7 I Copyright © 2017 Tech Mahindra. All rights reserved.
The radical
business-shift
I Copyright © 2017 Tech Mahindra. All rights reserved. 8
The shift is significant!
Smart watches, Digitizing across Connected Cars
Smart TVs, all verticals Smart homes,
and automobiles
Smart devices! Smart cities
Wide Variety of
Data offerings Social media
Smart phones Voice is rare! It’s
across User brings the world
a VoLTE world! together!
demographics
Internet Not much
Mostly Limited Landlines Paper bills,
Videos – of social
Voice- Data are a hard-
rather connects ..
usage offerings .. necessity! copies ..
rare! !
9 I Copyright © 2017 Tech Mahindra. All rights reserved.
Birth of the digital paradigm 10 I Copyright © 2017 Tech Mahindra. All rights reserved.
New trends in the Telecom space
The consumer-oriented “things” that
comprise the IoT—including wearables,
connected cars, smart homes (e.g., lighting,
security, entertainment), and the
government and enterprise-connected
“things” such as smart businesses (e.g., fleet Amazon style platform to support
management), and smart cities (e.g., an a la carte approach to selling
parking, city lighting, asset monitoring and video programming, potentially
While they are still tracking, and video security) from a wide range of sources
relatively niche products, delivering content to any screen is
wearables such as smart finally becoming a reality, enabled
watches and fitness bands by advances in network technology
have seen tremendous and higher speeds, as well as
percentage growth. enhanced content at the carrier
level, whether owned or resold
Smartphone sales are still
strong, the highest growth
percentages coming in the Modernizing Telco Operations with the autonomous
45-54 and 55+ age help of Digital Transformation having vehicle has quickly
demographics–groups that a huge scope for Automation emerged as a viable
have previously lagged Cater to incremental demand for and highly desired
behind younger consumers Value-added Infrastructure Services product for
due to Mobile video calling consumers
and other multimedia offers
11 I Copyright © 2017 Tech Mahindra. All rights reserved.Telcos enabling Digital transformation for
other verticals
Healthcare Entertainment Transportation Manufacturing Banking
Digital Medicine Movie Tickets Self Driving Vehicles 3D Printing Crypto Currencies
Concert/Shows Biometric
Digital Genomics Robotic Drones Robotics Authentication
Sports
AI Physicians
Space Elevator Crowd Funding
Nano Manufacturing
Mobile Care Content
Virtual Bank
Telco is a key enabler to other industries for their Digital Transformation through its Digital products & service
offerings and differentiated Business Models based on strategic partnerships
12 I Copyright © 2017 Tech Mahindra. All rights reserved.A few expected fallouts
Big Data market is expected to grow from USD 28.65 Billion in 2016 to USD 66.79 Billion by 2021, at a high Compound Annual Growth Rate (CAGR) of 18.45%
Spending on Self-Service Visual Discovery and Data Preparation Market Will Grow 2.5x Faster Than Traditional IT-Controlled Tools
Spending on Cloud-Based BDA Technology Will Grow 4.5x Faster Than Spending for On-Premises Solutions
Big Data, Data Science & Analytics Professional Services will Have a CAGR of 23%
13 I Copyright © 2017 Tech Mahindra. All rights reserved.The business asks
of today
I Copyright © 2017 Tech Mahindra. All rights reserved. 14What lies beneath and what is sought for – the Big Data asks of today!
Predictive Analytics enabling Scalable, extensible,
A platform integrating internal and external
strategic decisions modular and agile
business information
expected!
What is
Powered by Self-service Enabling effective Offering a single-version-of- Enabling Digital Analytics
& ad-hoc analysis Campaign Management truth of the Customer for the future
Today’s business realities and challenges
Social
Grouping &
Networking
Data and
Video – Social Media &
Voice is Sentiment
The TCO “legacy” Analytics
challenge
Contextual
with the
Marketing current data
explosion
IOT, M2M
Diverse market
Customer and consumer
Experience behavioral
Deriving and trends Data
monetizing Privacy – a
value from growing
data urgency
15 I Copyright © 2017 Tech Mahindra. All rights reserved.Big Data and the 4 Vs
Big data in reality Volume Variety Velocity Value
Filter Detect Act Diagnose Restore
Anomaly Detection Using past records,
Technique Real time notification Real-Time action
Techniques
automatically by automatic incident history, create
• Textual triggering
aggregates, categorization/Time creation by integrating diagnosis for every
correlates and then • Textual similarity and with CRM and incident incident
ranks the Topology, Knowledge management.
“Significance” of and Recipe
• Neural Net Feedback Previous
each Event Type Knowledg Runboo
e k
Trigger
s
Real-time
‘streaming Collaboration
data’ Analytics
Events
Event Ranking Detect Anomalies Actionable Prescriptive Automation
Events: Millions of Benefits: Analytics
Intelligence
Events, CDRs Get •>80 % reduction of
Triggered from OTT actionable items
Apps, Services & Offline •Diagnostic Alert
Networks process narrative
16 I Copyright © 2017 Tech Mahindra. All rights reserved.Combating the ‘V’ challenges
Volume Challenge
• Network 4g Data
Variety
storage
Velocity • Alerts and Logs
• Increased cost of
Operation
• Mobile Data Explosion • Real time alerts • Sensors and Devices • Requirement of diverse
• Data increase from xTB • Real time analytics • Machine-generated Technology array
to 100xTB • Zero latency reporting communications and • Ecosystem maturity
• N/W Alarms and data transactional activity • Demand for new age
requirements/Use cases
growing exponentially
Data Sources
Multi-machine Commodity Hardware
Alerts Dashboards
o Flexible and resilient
Data Virtualization
Sensors o Immensely Scalable
Semantic Layer
Pre-built Reports
N/W Events
Big Data platform powered by
o Faster processing and movement
Ad- Hoc Reports
Alarms o Huge TCO Improvement
Data Landing Data Lake
Zone Score Cards o Improved Decision-enablement
Probes Data
o Significantly Reduced Time-to-Insight
N/W Logs
Analytics
Social media
17 I Copyright © 2017 Tech Mahindra. All rights reserved.And delivering business value across the chain
Portfolio & Contextual Dynamic Customer Customer Experience
Campaigning Segmentation improvement
Omni-channel Churn Propensity
Data Anonymization
experience Analytics Analytics
Enabling an effective Network Congestion
Call Drop Analytics
Product strategy Control
Enabling Revenue
Assurance & Fraud Voice of Customer 360⁰ Social Media Analytics
Prevention
Network Experience Next-Best Action / Next-
Improvement Best Offer
18 I Copyright © 2017 Tech Mahindra. All rights reserved.New world,
new necessities –
Wrangle and realise
the VALUE
of your data!
I Copyright © 2017 Tech Mahindra. All rights reserved. 19Big Data – the Data-value realization challenge
Volume Velocity
Read & visualize data from Data Lake
Join & transform data from multiple sources Variety Value
Data is available, BUT….
Generate reports from data on HDFS, Hive, RDBMS Can I access and decipher it? AND
Can I derive value from it?
Reduce Efforts for Techie, IT & Data Scientist for data insights?
20 I Copyright © 2017 Tech Mahindra. All rights reserved.Data access trends across user-communities – the 80:20 paradox
Business
Leaders,
Business Data C-Suite Execs
Analysts
SQL Analysts
Data
Data Scientists Engineers
Petabytes & Hundreds of Megabytes & Gigabytes
Terabytes Gigabytes The community that decides!
Analytics / Insights
21 I Copyright © 2017 Tech Mahindra. All rights reserved.Addressing the pain
.. accelerating the realization of Data-value
Facilitating interaction between people and data throughout the Analytics lifecycle
TRIFACTA: The Global Leader in Data Wrangling
Business Value ($)
Driving
Business
Benefits
Analyzing
Excel IT
Prepping Driving
Business
Analyzing
Benefits
Prepping
DIY (Scripting)
22 I Analysis Process (Time Spent)
Copyright © 2017 Tech Mahindra. All rights reserved.Acknowledged as the leader across the board 23 I Copyright © 2017 Tech Mahindra. All rights reserved.
Moving towards a
‘converged’ BI
landscape
I Copyright © 2017 Tech Mahindra. All rights reserved. 24Huge storage and rapid Processing – how have we done?
Storage capacities of hard drives have increased massively over the years ( Moore’s law ), but access speeds—the rate at
which data can be read from drives (or written to drives) — have not kept up in comparison to Storage Capacity.
For Example:
o One typical drive from 1990 could store 1,370 MB of data and had a typical transfer speed of 4.4 MB/s, so you could read all the data
from a full drive in around five minutes.
o 20 years later, one terabyte drives are the norm, but the transfer speed is around 100 MB/s, so it takes more than two and a half
hours to read all the data off the disk.
Unfortunately, a rather long time to READ all data on a single drive—and writing is even slower!!
Solution? Obviously Parallel Processing!!
Most of these models use commodity hardware and hence were developed to address the issues of hardware failure and combining input /
output from multiple discs. The most popular one is Hadoop as on date.
o The distributed storage is provided by HDFS
o The analysis is provided by Map-Reduce.
o It has a Distributed Data Storage and Distributed Data Processing Framework that handles petabytes of Data in limited time
In April 2008, Hadoop broke a world record to become the fastest system to sort a terabyte of data - Running on a 910
25 I node cluster, Hadoop sorted one terabyte in 209 seconds!!
Copyright © 2017 Tech Mahindra. All rights reserved.Increasing significance of ‘analysis’ across the business-chain
Technology focused offerings with focus on enabl Not just
ing our clients to become Insights-Powered, Data Technology Business focused offerings with specialized and
- Driven Enterprises Solutions but .. .. comprehensive pointed use-cases for customers across
Business Solutions various process streams
Using some of the latest technologies & Platform
s With an intention to drive value with ‘Cultivati Focus is to deliver business value harvesting our
ng advanced Analytics’ theme experiences, domain knowledge and Platforms
Customer Revenue Assurance
Network Social Media Churn
Analytics & Leakage
Analytics Analytics Analytics
Embedding Analytics to Enhanced cost and Operational Enhanced Customer
Cross / Up-Sell Retention
cash advantage Excellence
26
Excellence
I Copyright © 2017 Tech Mahindra. All rights reserved.Lots of data! .. but what is it’s value?
Transform
experiences
Insightful and
Predictive
Leverage insights to
identify new revenue
opportunities
Prescriptive and
process-embedded
Descriptive
and diagnostic
Assessment and availability Storage and segregation Insights and intelligence Segment and sell
27 I Copyright © 2017 Tech Mahindra. All rights reserved.How could the data be ‘monetized’?
Internal Monetization The mantra – Keep Your Money and just give me your DATA!
External Monetization An effective Data Monetization solution – 2 imperatives…
Companies using
customer’s data
insight for
cross/up sales of
their product &
services to their Organizations can Capture diverse info,
customers structured and
monetize customer’s
unstructured alike
data by collaborating
with a range of Solution to capture and
process all forms of data
customer facing featuring across various
industries like sources
Advertising, Marketing,
Financial Services, Retail,
Ecommerce, etc.
Prevent Security breach
of any Customer PII
A robust and automated
Data-masking and
anonymization solution
28 I Copyright © 2017 Tech Mahindra. All rights reserved.No more merely the eyes and ears of the enterprise
but beyond … possibly its brains and hearts?
Highly Customer-Centric Technology Transformation Business-Model
re-engineering
Gain Share
Advanced Cognitive and AI Business Model Packaged BI solutions
Analytics
BI Modernization
Data
M2M & IOT Hybrid BI Management Analytics as a Service
platform Services
Crowd- Engage Engage
sourced third-party/ Partner with Pro-actively assess
strategic
from niche partners Academia and address
community players Customer Needs
Customer
Co-innovation
29 I Copyright © 2017 Tech Mahindra. All rights reserved.The world has gone F A R ahead!
Lets
Can we flatten the Columnar storage – Could we please think
F ‘Dimensionalize’, lets
build a Star-schema
Star further? they are good! Schema-less!!
Multi-batch per Near real-time
day norm days
A
•Lets refresh •8 hours .. Oops! •Can I have
once a day – we •Could we get a Need it hourly!! analytics
•Oh no!!! Would
should be feed every 8 or embedded in
need a data
good! 10 hours? 24 my process!!
stream – delays
hours is long! proving costly
The “Daily batch” Intelligence into
Latency steeps up! …
era the transactions
E-Mail
R Conversation
between Tom
Instant chats as
if Jill and Bob
were speaking!
A group
discussion – all
views invited!
Not restricted to
humans only!
Machines are
also gaining
intelligence!!
and Julie
30 I Copyright © 2017 Tech Mahindra. All rights reserved.A long-journey into today’s truly ‘Converged’ world
Consistent! Conjoint .. Cloudy ..! Conglomerated Converged!!
Genesis of Hybrid BI –
Classical RDBMS
complemented with a
Focus on the Cloud – Hadoop platform
Public, Private, Hybrid, Bringing together the
Advent of the Appliance Community laptops and mobiles;
– a con-joint approach of
interchangeability
putting the S/W and
between products and
H/W in step
services; thinning down
the lines between the
EDW, single- ‘Analytical’ and
version-of-truth, ‘Transactional’ worlds
consistent, through ‘embedded’
conformed Analytics into
transactional Business
processes
31 I Copyright © 2017 Tech Mahindra. All rights reserved.Thank you
For more information, please visit www.techmahindra.com
Disclaimer
Tech Mahindra Limited, herein referred to as TechM provide a wide array of presentations and reports, with the contributions of various professionals. These presentations and
reports are for information purposes and private circulation only and do not constitute an offer to buy or sell any services mentioned therein. They do not purport to be a complete
description of the market conditions or developments referred to in the material. While utmost care has been taken in preparing the above, we claim no responsibility for their
accuracy. We shall not be liable for any direct or indirect losses arising from the use thereof and the viewers are requested to use the information contained herein at their own
risk. These presentations and reports should not be reproduced, re-circulated, published in any media, website or otherwise, in any form or manner, in part or as a whole, without
the express consent in writing of TechM or its subsidiaries. Any unauthorized use, disclosure or public dissemination of information contained herein is prohibited. Individual
situations and local practices and standards may vary, so viewers and others utilizing information contained within a presentation are free to adopt differing standards and
approaches as they see fit. You may not repackage or sell the presentation. Products and names mentioned in materials or presentations are the property of their respective
owners and the mention of them does not constitute an endorsement by TechM. Information contained in a presentation hosted or promoted by TechM is provided “as is” without
warranty of any kind, either expressed or implied, including any warranty of merchantability or fitness for a particular purpose. TechM assumes no liability or responsibility for the
contents of a presentation or the opinions expressed by the presenters. All expressions of opinion are subject to change without notice.
32 I Copyright © 2017 Tech Mahindra. All rights reserved.You can also read
