DZone
DevOps Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > DevOps Zone > Continuous Testing Insights from Forrester’s Latest Wave

Continuous Testing Insights from Forrester’s Latest Wave

Shifting left, early adoption and use of testing methods, and functional testing are all concerns for Continuous Testing environments.

Cynthia Dunlop user avatar by
Cynthia Dunlop
CORE ·
Mar. 14, 19 · DevOps Zone · Analysis
Like (4)
Save
Tweet
5.21K Views

Join the DZone community and get the full member experience.

Join For Free

Forrester just released The Forrester Wave: Global Continuous Testing Service Providers, Q1 2019. The focus was on evaluating the top Continuous Testing Service Providers and rating how they stack up. However, you’ll want to scan this report even if you’re not in the market for Continuous Testing services.

Diego Lo Giudice continues his mission of helping IT leaders understand how quality processes must evolve for Agile and DevOps success, and what specific actions are needed to bridge the ever-widening gap between where we  are and where we need to be.

You can read the complete report here, courtesy of Accenture (one of the leaders named in the report). Here’s a quick summary of some of the key insights…

Test Data Management (TDM) is Gaining Traction

The results from the 2019 survey indicated a greater interest in test data management (TDM) than the previous (2017) survey. What’s behind this increased interest? The report explains, “End-to-end Continuous Testing requires self-service, fast-life-cycle updates of secured test data. A strong testing process won’t produce strong quality if you don’t feed it the right data at the right time.”

Performance Testing Needs to (Dramatically) Shift Left

Digital, mobile, and IoT are making early performance testing essential. Forrester recommends a much more dramatic “shift left” than most companies are prepared for, though: “Shift-left means running performance tests as early as possible during development to ensure designs and components work — many also call this ‘unit’ or ‘local’ performance testing.”

Functional Testing, TDM, and Left-Shifted Performance Testing Are the Most Impactful for Quality at Speed

Over two-thirds of respondents cited functional test automation (UI-, data-, or API-driven) as the most impactful automation service for achieving quality at speed. Here’s how all the best practices ranked (from most important to least):

  1. Functional test automation
  2. Test data management
  3. Performance testing (left-shifted)
  4. Service virtualization
  5. TDD/BDD
  6. Functional test design automation (model-based, AI-driven, or other)
  7. Exploratory testing
  8. Mobile testing
  9. API test automation
  10. Security testing
  11. Cloud-based test environment provisioning
  12. Testing in production

Test Automation Rates Remain Dismally Low (But Many Companies are Making Strides)

Forrester recommends test automation rates of over 80% to meet the demands of two-week Agile sprints. However, only 12% of surveyed reference clients achieved that level of test automation. One bright spot: more than half of the reference clients working with Continuous Testing service providers such as Accenture, Infosys, Sogeti, and Wipro now automate 50%+ of their functional testing.

Pipeline (software) Test data Test automation Data management Service virtualization

Published at DZone with permission of , DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Challenges to Designing Data Pipelines at Scale
  • An Overview of Key Components of a Data Pipeline
  • The Engineer’s Guide to Creating a Technical Debt Proposal
  • A Simple Guide to Heaps, Stacks, References, and Values in JavaScript

Comments

DevOps Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo