DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
  1. DZone
  2. Testing, Deployment, and Maintenance
  3. Testing, Tools, and Frameworks
  4. Viewing Test Suite Reports in Katalon Studio

Viewing Test Suite Reports in Katalon Studio

Learn about test suite reports and related functions in Katalon Studio, a testing platform allowing you to monitor your test status.

Oliver Howard user avatar by
Oliver Howard
·
Oct. 05, 17 · Tutorial
Like (6)
Save
Tweet
Share
7.72K Views

Join the DZone community and get the full member experience.

Join For Free

Katalon Studio is designed to ease many challenges that manual testers are facing. In a large project, there may be hundreds or even thousands of test cases and test executions. Test suite reports produced by Katalon Studio allow users to monitor their test status and have a better understanding of their project’s test coverage. This guide will give you an overview of reports and related supported basic functions.

Once a test suite finishes its execution, a historical report is automatically generated and stored in the Reports section of Tests Explorer. Test suite execution reports are placed in chronological order with the most recent one on top.

For example:

test suite reports

The report will be named with following the naming convention: YYYYMMDD_HHmmss, which is the date and time when the test suite starts its execution.

Report Overview

In the Test Explorer view, double-click on a historical execution of a test suite to view its details:

Test Explorer view

where:

Component Description
Test Cases Table List of executed test cases.
Summary Summary information of executed environment.
Execution Settings Settings for execution which include information about how to handle a failed test case, page loading timeout, etc. For example:

page loading timeout

Execution Environment Information concerning the execution environment, including Host Name, Operating System (os), Katalon Studio version, browser, etc. For example:

Information concerning the execution environment

Test Cases List

  • The Test Case Table displays the list of all executed test cases in a test suite. If data-driven testing is used, each test case will be executed through a number of times (iterations) that are defined in the Data Iteration column of the current test suite as shown in steps No. 5 to 7 below.

Katalon Studio Test Case Table

Users can easily determine what information to display by using the filters.

Filter Description

Passed status Katalon StudioPassed

Show only iterations which are passed.
Failed status Katalon Studio
Failed
Show only iterations which are failed.
Error status Katalon Studio
Error
Show only iterations having errors.
Incomplete status Katalon Studio
Incomplete
Show only incomplete iterations
  • By selecting an iteration in Test Case Table and click Show Test Case Details, you can view details regarding its executed logs.
  • If qTest and JIRA are configured in Project Settings, you can submit the results to these systems. Refer to qTest Integration and JIRA Integration for more details.

Test Suite Summary

This section explains the information on the test execution summary report for a test suite, as shown below.

test execution summary report

The fields include:

Field Description
Test Suite ID The ID of the executed test suite in Katalon Studio. Once clicked, the test suite is opened.
Hostname / OS / Platform The environment where the test suite is executed
Start / End / Elapse Execution start/end date time and duration
Total TC The total number of test cases, grouped into four status groups, Passed, Failed, Error, and Incomplete.

Test Case’s Log

Test Case’s Log shows the detail of a test case after execution. Users can view such details in three tabs Test Log, Information, and Integration. Double-click on a test case in Test Cases Table to display the Test Case’s Log window.

Test Log Tab

  • Details of the executed steps and their status are displayed in this tab.Details of the executed steps

Detail of the items:

Component Description
Log Information

Information of the selected iteration in the Test Case’s Log section:

  • Name of the test step (the name of the keyword used in the test step)
  • Execution Start/End date time and duration
  • Description of the test step
  • Any system Message raised when the test step is executed.
Log Image

The screenshot taken from the application under test, it is captured in either of the following situations:

  • An error occurs during test execution
  • The Take Screenshot keyword is used
  • Users can easily determine which type of information to be displayed by using the provided filters:
Filter Description
Info
Info
Show the messages logged for information/reference.
passed status Katalon Studio
Passed
Show the steps which are successfully executed.
Failed status Katalon Studio
Failed
Show the steps which failed to execute.
Error status Katalon Studio
Error
Show the steps having errors.
Incomplete status Katalon Studio
Incomplete
Show incomplete steps.
Warning status Katalon Studio
Warning
Show the steps which have warning status.
Not Run status Katalon Studio
Not Run
Show the skipped steps.
  • If JIRA is configured in Project Settings, users can submit a ticket to this system. Refer to JIRA Integration for more details.
  • Screenshots are taken for the failed steps and users can hover the mouse cursor over the attachment icon to review.

Information Tab

Users can find the summary information of the test case in this tab.

 summary information of the test case

The items include:

Field Description
Test Case ID The ID of the executed test case in Katalon Studio. Once clicked, the system navigates users to the respective test case.
Start / End / Elapse Execution start/end date time and duration.
Description Description of the test case.
Message Any system message raised when this iteration is executed.

Integration Tab

The information regarding qTest Integration of this iteration is displayed in this tab.

The information regarding qTest Integration

The fields include:

Field Description
Test Log ID The ID of the integrated qTest Test Run. Once clicked, the system navigates users to the respective qTest page.
Test Run Alias The alias of the integrated qTest Test Run.
Attachment Indicate whether all execution logs and reports are placed in a zipped file to be sent to qTest as an attachment.

Export to Other Formats

For the purpose of sharing, users can generate reports of test suites into other formats such as HTML, CSV, PDF, and JUnit using the context menu in Test Explorer as the example below:

generate reports of test suites into other formats

Katalon Studio’s Reports feature allows users to have an overview of test execution by providing most important details and necessary information from PASSED/FAILED result to details on the execution environment, test summary, or logs. Using this information, test managers and QAs can better manage and track test activities, resulting in improved testing productivity.

Stay tuned and keep exploring Katalon Studio with the Resources Center!

Testing Test suite Katalon Studio Test case

Published at DZone with permission of Oliver Howard. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • ChatGPT: The Unexpected API Test Automation Help
  • Express Hibernate Queries as Type-Safe Java Streams
  • How to Secure Your CI/CD Pipeline
  • How To Check Docker Images for Vulnerabilities

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: