Over a million developers have joined DZone.

The Role of Data Analytics in Digital Business

DZone's Guide to

The Role of Data Analytics in Digital Business

Understanding the basics of data analytics is easy. Understanding how to transform an organization with analytics? Not so much. Read on for a simple explanation.

· Big Data Zone ·
Free Resource

The open source HPCC Systems platform is a proven, easy to use solution for managing data at scale. Visit our Easy Guide to learn more about this completely free platform, test drive some code in the online Playground, and get started today.

When someone tells me they want to do analytics, I say that it is easy. I can explain it in five minutes. However, if someone says that they want to transform an organization using analytics, my reaction is, “How long do you have?”

It is not easy. Let’s dissect how to do it.

Digital Business

There is a new buzzword in the block: digital business. What is that?

The idea stems from few businesses that managed to rethink the world.

Uber built a taxi company without owning cars or employing drivers. Airbnb built a hospitality service without owning rooms or hotels. Media and retail (i.e. Amazon, eBay) have been transformed by digital.

We call such a business a digital business. Digital businesses use digital technologies to fundamentally rethink the way businesses are done. The path to becoming such a business is called digital transformation. 

Following are three good references. Each has a slightly different interpretation of “digital transformation.” At the same time, there is enough census to make it useful.

  1. Next: Economy Newsletter — O'Reilly Media

  2. How to Navigate a Digital Transformation

  3. Building a Digital Business Technology Platform


Why do we need this? New technology has amused us and connected us. Yet, not all are amused. A 2012 MIT Technology Review headline ran You promised me Mars colonies. Instead, I got Facebook. Many have argued that despite amusement, new technologies have not lead to fundamental advancements.

Technologies like the internet are omnipresent. However, critics argue that those technologies have failed to fundamentally change our lives or add major efficiencies like advancements did in the Industrial Revolution.

My hope is that redefining around the digital can bring in those missing efficiencies and leapfrog us to the future. It's needless to say that if any organization can do that, they will leave their competition in the dust. Hence, it is not much of a choice. Any organization who wants to be around in 10-20 years will have to do that.

Companies like Uber, if they do it right, can change the way we live. For example, Uber provides a future where many of us can survive without a car, reducing traffic and reducing costs.

Analytics in Digital Business

Three classes of digital technologies can play a part in this transformation: analytics and AI, social mobile and IoT, and crowdsourcing. This post explores the role of analytics and AI.

The following picture shows a component of a digital business. This is by no means the only representation. Yet, the following picture captures most ideas discussed under digital business. Furthermore, it lists five areas where analytics can play a major role within a business.

The next sections explore each in detail.

Improve Operations

The key idea is to collect data about the organization and use it to improve operations. This is the most widely discussed benefit of analytics. The unstated assumption is that the organization has a lot of friction and inefficiencies. I am sure most of you will agree that this is true.

There are many use cases that fall under this. Following are a few.

  • Predictive maintenance i.e. production lines, equipment, vehicle fleets, and sites.

  • Optimizations, scheduling, and responding to issues i.e. making sure the right person is playing the right role and has access to everything they need.

  • Fraud detection and prevention.

  • HR analytics i.e. finding the best candidates, filtering candidates, performance appraisal analytics and proactive intervention, andchurn prediction.

  • Security and surveillance.

Key for optimizations is knowing what to measure. We used the term KPI (Key Performance Indicators) to describe those measurements. KPI is a simple indicator that represents an important aspect of the situation.

A good example of a KPI is thinking about canaries in the coal mines. Years ago, miners took canaries and other small birds into coal mines. These birds are very sensitive to oxygen levels. If the oxygen levels are low, they will get knocked out. Then, humans have an advance warning to rush out of the mine.

Following are other examples of KPIs.

  • GDP and life expectancy for a country.
  • Revenue per square foot in a retail store, revenue per employee, and revenue in the organization.
  • Customer lifetime value (CLV) and customer acquisition cost (CAC) in sales and marketing.

Yet, the given KPI will only see a part of the picture. Hence, a narrow focus on the KPI can lead to suboptimal outputs. To tackle this problem, Andy Grove (Intel) argued in his book High Throughput Management that KPIs should be used in pairs. The first KPI should measure the output (i.e. processed claims count) and the second should measure the quality (i.e. mistakes occurred). Together, two KPIs provide a holistic view of an organization.

Most domains have well-defined KPIs. Defining new KPIs is hard work. Before optimizations, you must define the KPIs. Then, you need to either measure them or find a way to approximate the KPIs. What you need to measure is not what is easy to measure, but what is useful.

Facts do not cease to exist because they are ignored.  —  Aldous Huxley

When you have found the right KPIs, the rest is relatively easy. We can use KPIs to find problems, come up with and apply solutions, and to find the effectiveness of our solutions. We can apply the process in an ongoing basis to improve operations.

Get Close to Your Customers

Analytics can optimize organization’s interaction with customers and create new dynamics. This can happen in many forms.

  1. Analyzing customer-product interactions can improve the functionality and user experience of a product (i.e. adding a timer to the coffee machine).

  2. Send customers periodic emails with key usage patterns and insights. This will also provide opportunities for cross-selling and upselling.

  3. An app connected with the product provides a communication channel to the customer. For example, the customer can use the app to report any issues, provide feedback, and schedule appointments. At the same time, you can use the app to keep then informed, push offers and advertisements.

  4. Connect with the customer via social media and follow them to understand their likes, dislikes, and sentiments. These insights can be used to take product decisions. For example, if customers use some other product with your product, maybe you need to partner with another company or create a competitive product. Furthermore, the same data can be used to track sentiments and understand the brand’s ups and downs.

  5. Find problems and take the initiative to solve them before other customers experience the problem and push updates to other customers proactively.

  6. Keeping touch with customers regularly will let you run efficient marketing campaigns. For example, we can do events and activities in the areas with high density of the customers. This creates network effects that lead to more sales. For example, we can invite a few customers when you make a donation to the hospital or sponsor a school event.

  7. Create users groups to let the customers talk to each other and learn from each other. You will find network effect drive them to more adoption. Mercedes-Benz Club is an example of this idea. However, in the world of social media, these clubs can operate cheaper than before.

Improve Marketing and Sales

Marketing is scouts and sales are hunters. Customers often start as visitors on the website. Marketing brings in new visitors in several ways.

  1. Creating content that perspective customers will be interested in and publishing them on the site.

  2. Engaging in lead generating activities such as workshops, sponsoring events, external publications, etc.

  3. Digital advertisements.

  4. TV, SMS, and print media advertisements.

Then, marketing identifies, keeps track of, and nurtures visitors through newsletters and other activities. Sales engage in making the sale when ready. Analytics can identify and track leads as they move through the marketing and sales pipelines.

Following are some things analytics can do.

  1. Optimize the time spent on lead nurturing by ranking leads by their effectiveness (i.e. using Machine Learning models using historical data).

  2. Track, analyze, and understand the effectiveness of published content, traffic sources, and the impact of the message on traffic.

  3. Running an efficient digital media campaign.

  4. Mapping out the customer journey using the data collected from their interactions enables us to understand customers and to guide them through the journey. This includes recommending the best material (i.e. other customers from the same domain and others who do similar things) and helping get them through the sales process as fast as possible, as well as perspective customer profiles to get them to the right customers to build confidence.

  5. Understand the physical location of customers and use that to optimize the one-to-one interactions.

  6. Tracking topics related to product and producing content that utilizes those topics.

Create New Revenue Streams and Products

Under this topic, there is no limit to things you can do. Following are some favorites.

Intelligent Products

Some products need humans to tune them, and it is hard to get them right. Machine Learning can take away the burden. For example:

  1. An oven that decides how long it takes to cook and adjust temperatures automatically.
  2. A washing machine that determines the size of the cycle and optimizes the water.
  3. Smart products that optimize for energy bills and comfort (i.e.. Google Next).

New Experiences

  1. Bose headphones that let you talk in a noisy environment.
  2. Fit gadgets i.e. Fitbits, shoes, etc.
  3. Cameras that use multiple small cameras and combine images using Machine Learning to produce high-quality photos.
  4. Let you control or check the status of a product remotely (did I turn off the oven, heater, iron?).
  5. Products that provide new input methods (i.e. take a picture instead of typing or speaking). 

Solve a Problem

  1. A fridge that keeps an inventory of what is inside.
  2. Tracking things you forget or lose (i.e. key, wallet).
  3. Surveillance (i.e. when is the last time something moved?).
  4. A medicine dispenser that reminds you to take medicine.
  5. A cup that measures content (i.e. sugar intake).
  6. Trackable wallet, backpack, etc.
  7. Digital twin for analysis, reasoning, and diagnosis.

Create Value Networks

When you run a business, you create a network of many different people and entities. It is likely that this network can play a bigger role that part of the business and used to your advantage. This network that connects customers, the organization, supply chain, and distribution chain is called a value network.

For example, Walmart provides detailed analytics about their products to suppliers, which let them improve products. These analytics act as value added advantage for the supplier for working with Walmart. The same idea can be used across many businesses where you can not only use intelligence but also pass over intelligence to other parties.

A company value network might provide a great opportunity to create and distribute a new product. A good example is the Nespresso Case study, where Nestle used their distribution chain to sell expresso machines and how they managed to defend the revenue stream through the coffee pods.

Moreover, there may be other products that sell together with your products. For example, many items go together such as diapers and wet wipes or pizza crust and cheese. Understanding them might give you several opportunities.

  1. You can compete by creating a new product and using your distribution line to sell it.

  2. Make a deal with the supplier of the other product to either share revenue for sales you bring to them or to share the marketing costs.

  3. Negotiate with the supplier to give your customers a better deal.

Finally, the information that can be collected through the value chain might be useful. For example, the distribution chain can provide data about the demographics of users or their reception.


It is easy to do analytics. However, it is hard to change organizations and change the world using analytics. The idea of digital business brings this problem into focus.

This post tries to look at organization holistically and discusses how analytics can be used to rethink how to do business. This post intentionally does not discuss how to do it (technically), rather tries to cover what to do using some use cases.

If you are looking to implement these use cases, you have a choice of many tools. Among them are WS02 Stream Processor, Apache Spark, Apache Flink, Apache Storm, and Kafka Streams. Please report to respective web sites for more information. 

Hope this was useful. If you enjoyed this post you might also like Stream Processing 101: From SQL to Streaming SQL and Patterns for Streaming Realtime Analytics

I write at https://medium.com/@srinathperera.

Managing data at scale doesn’t have to be hard. Find out how the completely free, open source HPCC Systems platform makes it easier to update, easier to program, easier to integrate data, and easier to manage clusters. Download and get started today.

big data ,data science ,digital business ,data analytics

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}