DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Please enter at least three characters to search
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

Zones

Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks

Because the DevOps movement has redefined engineering responsibilities, SREs now have to become stewards of observability strategy.

Apache Cassandra combines the benefits of major NoSQL databases to support data management needs not covered by traditional RDBMS vendors.

The software you build is only as secure as the code that powers it. Learn how malicious code creeps into your software supply chain.

Generative AI has transformed nearly every industry. How can you leverage GenAI to improve your productivity and efficiency?

Related

  • Understanding the Basics of Neural Networks and Deep Learning
  • Learning AI/ML: The Hard Way
  • Predicting Diabetes Types: A Deep Learning Approach
  • Neural Networks: From Perceptrons to Deep Learning

Trending

  • When Airflow Tasks Get Stuck in Queued: A Real-World Debugging Story
  • Designing AI Multi-Agent Systems in Java
  • Data Lake vs. Warehouse vs. Lakehouse vs. Mart: Choosing the Right Architecture for Your Business
  • Intro to RAG: Foundations of Retrieval Augmented Generation, Part 1
  1. DZone
  2. Data Engineering
  3. AI/ML
  4. Deep Learning Explained in Layman's Terms

Deep Learning Explained in Layman's Terms

In this post, you will get to learn deep learning through a simple explanation (layman terms) and examples.

By 
Ajitesh Kumar user avatar
Ajitesh Kumar
·
Oct. 08, 20 · Analysis
Likes (4)
Comment
Save
Tweet
Share
10.3K Views

Join the DZone community and get the full member experience.

Join For Free

In this post, you will get to learn deep learning through a simple explanation (layman terms) and examples.

Deep learning is part or subset of machine learning and not something that is different than machine learning. Many of us, when starting to learn machine learning, try and look for the answers to the question, "What is the difference between machine learning and deep learning?" Well, both machine learning and deep learning are about learning from past experience (data) and make predictions on future data. 

Deep learning can be termed as an approach to machine learning where learning from past data happens based on artificial neural networks (a mathematical model mimicking the human brain). Here is the diagram representing the similarity and dissimilarity between machine learning and deep learning at a very high level. 


Fig 1. How are machine learning and deep learning associated?


What Is Deep Learning?

Deep learning represents deep neural networks. Neural networks, with more than 1 hidden layer (or 2 or more hidden layers), can be referred to as deep neural networks. And the model created with neural networks having 2 or more hidden layers apart from the input and output layer is said to be based on deep learning. Before going ahead, let's understand what artificial neural networks are.

What Is Artificial Neural Network?

An artificial neural network is a bunch of computation units called neurons laid out in one or more layers while the neurons being connected with each other. Neuron as a computation unit can be expressed as a weighted sum of inputs and looks like the following:

\(w_0 + w_1x_1 + w_2x_2 + w_3x_3 + ... + w_nx_n\)

In the above equation, the \(w_n\) represents the weight and \(x_n\) represents the corresponding input. Each neuron is associated with what is called an activation function, which decides on the output of the neuron. When all the neurons across different layers are connected with each other, the neural network is also called a fully-connected neural network.

A neural network having just one neuron can be called as a single-layer neural network. It is called the perceptron. A neural network having one input layer, one hidden layer, and one output layer is called a multi-layer perceptron (MLP) network.

What Is a Deep Neural Network?

Deep neural networks are artificial neural networks with 2 or more hidden layers. Here is a diagram representing a deep neural network trained with inputs to create predictions (outputs). Make a note of multiple hidden layers and blue circles representing the computation unit called a neuron. As there are linkages between the computation unit — aka neurons — across different layers, so the name "neural network."


Fig 2. Deep Neural Network representing Deep Learning


How Does the Deep Neural Network Work?

The core of simple (single layer or MLP) neural networks or deep neural networks (2 or more hidden layers) is the computation units called neurons laid out in layers and connected with neurons of other layers. The neurons perform computation on input data and results in an output based on the activation function. These computations result in geometric transformations of input data. For instance, arithmetic operation on two vectors results in another vector that can be visualized in the following manner.


Fig 3. Vector addition resulting in new vector


Similarly, a rotation of a 2D vector by an angle \(\theta\) can be achieved via a dot product with a 2 × 2 Matrix.

Based on the above, it can be comprehended that a neural network can be seen as a very complex geometric transformation in a high-dimensional space, implemented via a long series of simple arithmetic operations. The following analogy is taken from the book, Deep Learning with Python by François Chollet. Deep learning can be understood as uncrumpling a highly folded data manifolds into a neat representation of data. It is the same as uncrumpling the paper ball to a neat-looking paper as shown in the below diagram.


Fig 4. Uncrumpling complex data representation (paper fold) to neat representation (straightened paper)


You may notice that once the paper ball shown above is uncrumpled, it becomes easy to identify the paper. In a similar way, deep neural networks uncrumple data with manifolds into simple representation step-by-step, layer-by-layer. Each layer in a deep network applies a transformation that disentangles the data a little-and a deep stack of layers making the whole process as a sophisticated disentanglement task like uncrumpling paper and straighten it well enough to understand the paper in a better manner.

Conclusions

Here is the summary of what you learned regarding the deep learning and deep neural network:

  • Deep learning is a subset of machine learning.
  • Deep learning is about learning from past data using artificial neural networks with multiple hidden layers (2 or more hidden layers).
  • Deep neural networks uncrumple complex representation of data step-by-step, layer-by-layer (hence multiple hidden layers) into a neat representation of the data.
  • Artificial neural networks having one hidden layer apart from input and output layer is called as multi-layer perceptron (MLP) network.
  • The most basic computation unit of a deep learning network is called a neuron. Multiple neurons form a layer.
neural network Deep learning Network Machine learning

Published at DZone with permission of Ajitesh Kumar, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Related

  • Understanding the Basics of Neural Networks and Deep Learning
  • Learning AI/ML: The Hard Way
  • Predicting Diabetes Types: A Deep Learning Approach
  • Neural Networks: From Perceptrons to Deep Learning

Partner Resources

×

Comments
Oops! Something Went Wrong

The likes didn't load as expected. Please refresh the page and try again.

ABOUT US

  • About DZone
  • Support and feedback
  • Community research
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 100
  • Nashville, TN 37211
  • support@dzone.com

Let's be friends:

Likes
There are no likes...yet! 👀
Be the first to like this post!
It looks like you're not logged in.
Sign in to see who liked this post!