DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
  1. DZone
  2. Data Engineering
  3. AI/ML
  4. Using Artificial Neural Networks for Lung Cancer Detection

Using Artificial Neural Networks for Lung Cancer Detection

Many radiology therapists are adapting machine learning algorithms to do less manual/routine work, speed up diagnosis, and increase the quality of medical care.

Ivan Ozhiganov user avatar by
Ivan Ozhiganov
·
Jul. 12, 17 · Analysis
Like (11)
Save
Tweet
Share
5.41K Views

Join the DZone community and get the full member experience.

Join For Free

Lung cancer is a major health problem and the leading cause of death among all types of cancer. Over the last seven years, computer tomography has allowed more cancers to be diagnosed at an early stage, and the mortality rate has been reduced by 20%.

Computer tomography, or CT scanning, is the main method of lung cancer diagnosis and is becoming increasingly popular. The more it’s used for lung cancer detection, the more tomographic images are produced worldwide. The fact that tomograms are usually processed manually by radiation therapists means medical personnel are flooded by routine work. That being said, tomogram processing is not an easy task. Increasing loads of complex work can reduce the quality of diagnosis and prevent health professionals from delivering medical care in time.

Why Manual Tomogram Processing Is Flawed

  • Diagnosis is slowed down.

  • Radiation therapists are overloaded with complex manual work.

  • A false diagnosis caused by a human factor can take place.

Machine learning and neural networks make it possible to automatically process X-ray pictures, tomograms, MRIs, and PET images to detect diseases. Many brands and research labs are adapting machine learning algorithms to speed up diagnosis and increase the quality of medical care.

Training an Image Processing Algorithm for Cancer Detection

The goal was to teach the algorithm to find abnormal areas called nodules in lungs. These nodules can represent cancer. To train neural networks, we used a dataset of 1,000 cancer CT scans with marked-up annotated lesions from LIDC-IDR.

The source images were in DICOM format: inhomogeneous and heavy. So we first needed to standardize all the images.

Preprocessing

  1. First, we converted voxels into world coordinates and in reverse.

    The object in different coordinate systems

  2. Then, we normalized data to avoid network failures.

  3. After that, we expressed CT numbers in a standardized and convenient form using the Hounsfield Unit. Here is a table of densities in HU.

    Materia

    HU

    Air

    -1000

    Lungs

    -500

    Fat

    From -100 to -50

    Water

    0

    Blood

    From +30 to +45

    Muscles

    From +10 to +40

    Soft tissues

    From +100 to +300

    Bones

    From +700 to +3000

  4. In the end, we rescaled all voxels to 1х1х1 mm to make use of a 3D CNN.

Segmentation

Lung structure masksLung structure masks







We segmented lungs to find nodules. Bright areas on the image represent either blood vessels or air. Using a -400 HU threshold, we segmented the lung structure and created a binary mask of lungs.

Training Neural Networks to Find Abnormal Areas

First, we applied image classification and separated all images into two groups: suspicious and normal. Then, we localized all suspicious areas using the neural network U-Net. See its architecture below.











We chose U-Net as one of the best networks for medical image processing. Moreover, this type of network is really good at cellular structure recognition. See the proof below.

U-Net segmenting cellular structures during ISBI 2012U-Net segmenting cellular structures during ISBI 2012

We trained our network to detect solitary pulmonary nodules. U-Net performed very well and found almost all abnormal areas. However, it detected some areas as “abnormal” by mistake.

From left to right: the expected result and the actual result









During the next step, we reduced the number of false positives and improved the detection accuracy using a 3D CNN.

3D CNN architecture




A 3D convolutional neural network was trained to classify abnormal areas found by the first network and separate them into valid and false. As a result, the number of false positives reduced drastically. The accuracy rate was equal to 0.925.

True Positive                                                          False Positive

A

B


Localizing nodules: A = found correctly; B = found by mistake.

The Outcome

The entire algorithm is great at finding abnormal areas in lungs. Even false positives were not a big problem since they were mostly located very close to real cancer. Furthermore, the algorithm often classified such areas with false positives as “suspicious” so that radiology therapists could check them anyway and detect cancer.

We believe this solution can be used to help radiology therapists do less manual, routine work and speed up cancer diagnosis.

neural network Network

Published at DZone with permission of Ivan Ozhiganov. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Top Five Tools for AI-based Test Automation
  • PostgreSQL: Bulk Loading Data With Node.js and Sequelize
  • How Do the Docker Client and Docker Servers Work?
  • A Real-Time Supply Chain Control Tower Powered by Kafka

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: