The Basics of Testing in DevOps

devops is not a methodology or a suite of tools but it is a concept to dismiss the barriers between dev and ops in order to meet the need for shorter and more frequent delivery timelines.

in devops, the organization responds in a more agile manner to changing business requirements. in this concept, systems engineers, release engineers, dbas, network engineers, and security professionals in the “ops” branch seamlessly integrate with developers, qa, business analysts, and product engineers in the “dev” branch into a single value it entity.

there are four basic continuous processes in devops:

• continuous integration
• continuous delivery
• continuous testing
• continuous monitoring

in devops, testing is not at the end of the release cycle — it is now brought into the mainstream/beginning of development cycles. developers and system engineers get the code in the right environment for continuous integration and continuous delivery and those stakeholders enable continuous testing and continuous monitoring processes in which qa engineers then validates that the team  has built the right application, by seeing and testing if it functions and performs as designed.

it is a fundamental role for testing teams to align their test design, test automation, and test case development with devops — not only to verify that code changes work but that the changes do not break the product. a key differentiator of devops is testing maturity. an organization can automate their integration, testing, delivery, and monitor it, but still have issues with the intelligence of test orchestration and automation, which can lead to a bottleneck if this is not resolved beforehand.

in most projects, testarchitect can be used in a general devops process. following the action based testing method, testarchitect offers capabilities to develop and automate test cases quickly in the same sprint as the application under test, thus allowing team members to become actively involved in the testing and automation process, each from their own skill perspective. apart from qa, other team skills/roles will typically be development, operations and product ownership.

in the four mentioned continuous processes in devops, testarchitect serves a very important role to connect and oil the process as below.

once the automated tests is ready, they can be put into test suites, and there execution can be defined in batch files, which can be executed by any scheduling or continuous integration tool, and even be used for testing in production. the results of the automation execution can be generated in xunit format, xml format, or html format which can be read and run report against.