DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Partner Zones AWS Cloud
by AWS Developer Relations
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Partner Zones
AWS Cloud
by AWS Developer Relations

Trending

  • Using DuckDB With CockroachDB
  • How To Become a 10x Dev: An Essential Guide
  • Enriching Kafka Applications With Contextual Data
  • Microservices: Quarkus vs Spring Boot
  1. DZone
  2. Data Engineering
  3. Big Data
  4. IoT Needs to Play Nicely With Existing Systems

IoT Needs to Play Nicely With Existing Systems

IoT is a vast new source of data. But only through combining it with already existing enterprise data will IoT truly come into its own as a force to be reckoned with.

Ishu Verma user avatar by
Ishu Verma
·
Sep. 08, 16 · Opinion
Like (7)
Save
Tweet
Share
2.78K Views

Join the DZone community and get the full member experience.

Join For Free

In the past, I'v discussed how businesses focus on deployable IoT solutions versus PoCs (proof of concepts) and the value of bringing intelligence to the edge. This time, I would like to look at the importance of combining existing enterprise data with an IoT data stream. 

Most enterprises have multiple constituencies of infrastructure, applications, employees, customers, suppliers, processes, and policies that are needed to run the business. Any new systems, including those dealing with IoT, need to be architected to fit within this context. The real value of IoT lies in combining the IoT-generated data with other enterprise data, but a key challenge is how to best integrate them.

The data integration challenge needs to be solved at several levels: data transformation (from one protocol to other), routing (getting data to where it is needed), manipulation, and analysis. Let’s explore this further by looking at the example of data analytics, an integral part of the IoT solution. After all, what is the point of collecting the IoT data in a Hadoop data lake if we’re not going to derive business value from it? Before the data scientists can build data models to derive intelligence from the IoT data, it requires several considerations:

  • Clearly defining business problems (similar to operational goals like reducing defect rates, finding the most efficient routes vs. nebulous goals of finding intelligence in sensor data).
  • Ways to integrate structured sensor data with other structured and unstructured enterprise data .
  • Addressing constraints (data governance or security requirements).
  • Deciding on analytics tools like SPSS, SAS, or R (open source).

The data scientist will need to work with cross-functional teams of subject matter experts to build the data model. For example, a company seeking to perform predictive analytics for aircraft engines gets data from various onboard sensors to monitor temperature and vibration data from the engines and braking systems. This data is then analyzed to establish patterns and relationships between various variables. This expertise is provided by engine manufacturers (GE, Rolls Royce, etc.) or by specialized vendors like Scientific Monitoring Systems (acquired by Intel). These vendors have deep domain expertise in engine controls, aerodynamics, and machine learning to predict engine component failure. This allows airlines to schedule predictive maintenance on demand instead of through time-based or reactive maintenance.

The data scientists at these vendors work with domain experts to create and continuously enhance these data models which provide reliable results. The data scientist has to be careful of false alarms, as it costs the airlines to schedule service where none is needed or worse — a false negative — failing to service an engine that should have been scheduled, resulting in flight delays or accidents. What kinds of tools do the data scientists need that will allow them to create data models that can work across various sources of data for IoT use cases? 

Similar challenges will be faced by each stakeholder in the IoT value chain. These stakeholders include factory technicians, operations managers, developers, system integrators, data administrators, system administrators, etc. Each of these challenges has to be addressed using the same rigor needed to build mission-critical, enterprise systems. 

In summary, the true value of IoT is not in the IoT-generated data itself, but in combining it with existing enterprise data. It is the sum of these parts that will help drive new insights into business problems or uncover new opportunities.

Data science IoT

Opinions expressed by DZone contributors are their own.

Trending

  • Using DuckDB With CockroachDB
  • How To Become a 10x Dev: An Essential Guide
  • Enriching Kafka Applications With Contextual Data
  • Microservices: Quarkus vs Spring Boot

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com

Let's be friends: