Cross-Browser Testing Made Easy With Katalon

Hi and welcome back. In the first chapter, you learned about the advantages of Katalon TestCloud. Now, let's move on and see how you can set up and use it in Katalon Studio. You can expect it to be very simple. Follow me in this tutorial, go to Katalon.com/download, install Studio, and you're good to go.

Here I have my Katalon Studio ready. You can also import a sample project by:

- Going to File > New Sample Project

- Choose a web UI project

- Give it a name and you're good to go

This box pops up asking you to integrate with TestOps. We'll skip this for now. You can always configure it following the path shown on the screen.

Now, to integrate Katalon Studio with TestCloud:

- Go to Project > Settings > Katalon TestCloud or simply click on the TestCloud icon on the toolbar

- Check the box Enable Katalon TestCloud integration

- Choose your organization in TestOps to run tests with

- Click Apply and Close

The integration is just that simple. Now, let's create and run some tests on TestCloud environments. We'll need to prepare a test suite since TestCloud currently supports executions at the test suite and test suite collection levels.

I've already had some test cases in this sample project. If you're not using a sample project, you can create a test case from scratch by right-clicking on the Test Case folder and choose Test Case. Then, you can use Record and Playback features, scripting mode, and keywords to create test scripts. We have already published a Record and Playback course to guide you on how to use this low-code approach. Pause this video, go there, and follow the instructions to create some simple test cases.

Alright, after having your test cases ready, let's add them to a test suite:

- Right-click on the Test Suite folder > New > Test Suite

- Give it a name and description

- Click OK

- In this test suite, continue to click Add and choose your test cases.

A test suite is used when you want to gather relevant test cases to verify a workflow or a feature or certain types of testing like regression testing.

I'll use the existing test suite in this sample project. There are 3 test cases in here. To run this test suite with TestCloud:

- Click on the dropdown icon next to the Run button

- Choose TestCloud

As this TestCloud Configuration (Beta) dialog appears, select your desired OS, browser, and version you want to run your tests with. At the moment, TestCloud support:

- Linux and Windows for operating systems

- Chrome, Edge Chromium, and Firefox for browsers

But more options are being added very soon. So make sure you check them out while watching this course.

Below, in the Tunnel section, the option of Execute with tunnel for private domain testing is unchecked by default. We'll skip it for now as we'll discuss this in the next chapters. Lemme set this up real quick... Then, click on the Run button.

Look at the Job Progress, you can see the tests are being executed on the selected browsers and OSs without the use of a tunnel. You don't see the browsers popping up and the test steps being executed on screen like usual since everything's happening on the cloud.

However, you can always keep track of the executed steps via the Log Viewer section below. It shows here again at the step openBrowser: The OS - Linux, Browser - Firefox, Version - 95. Once it's done, click on the Result tab to check out the results. All the tests passed. In the summary section, you can see my local OS is macOS, but the platform used to run the tests were Linux and Firefox, version 95. The Execution Environment tab also includes these information, including the local OS, remote OS for execution, Katalon version, browser with the version, and other details.

You can download the reports for this test suite execution by clicking on Export Report. Here it gives you certain formats, including HTML, CSV, and PDF. Alternatively, you can connect to TestOps and review all the test results there. For more information on reporting, make sure to check out our course Katalon Studio: How to Work With Execution Logs and Test Reports after this course.

Alright, that's how you run test suites with TestCloud. But what about test suite collections? A test suite collection allows you to group relevant test suites together, giving you more options and control over your test planning, management, and execution (like running them in parallel or sequential mode). To get what I mean, let's go ahead and create a test suite collection:

- Right-click on the Test Suite Collection folder > New > Test Suite Collection

- Give it a name

- Then, click on Add and choose your test suites

I'll use the existing test suite collection in this sample project. Then, select a test suite, double-click on the Run with column, choose TestCloud, continue to double-click on the Run Configuration. As the TestCloud Configuration (Beta) dialog appears, select your options for the operating system, browser, and version. Then, click on OK. Do the same for other test suites…

Before running this, don't forget to save it. You have the options to go for either the sequential or parallel execution mode. I will choose the second. This means my test suites will run simultaneously. The Max concurrent instances indicate the maximum number of test suites executed at the same time. Since I have only 2 test suites, I go for 2 and keep the Delay between instances as 0. Everything is set. Click on the Execute button to run this collection. Let's wait for the executions to finish...

Once it's done, click on the Result tab. Continue to select Show details to view the test results for a specific test suite. You can then download the reports and follow up from here. Very easy and simple, right?

One last thing I want to show you in this chapter is running tests with TestCloud via the command-line interface. You'll need to install the Katalon Runtime Engine to run tests in CLI or console execution mode. Alright, the easiest way is using the Command Builder. Click on the Command Builder button on the toolbar. Then, select a test suite or test suite collection. In the Executive platform section, choose Run With > TestCloud. Next, for Run Configuration, click Edit to choose your desired OS, browser, and browser version to run your tests. Skip the use of tunnel since we'll talk about that later. Click OK. Below we have the options for execution configuration like conditional termination or retry, but let's skip them to keep things simple this time. Finally, select Generate Command.

Our command line is created and shown on screen. You can see 3 parameters related to TestCloud here. Everything seems good. Then, Copy to clipboard. Next, open your cmd or terminal and paste the command in. Press enter to run the command Our tests are being executed. You can see the console logs to keep track of the executions.

That's the end of our first chapter. You've learned how to integrate and run test suites and test suite collections in Katalon Studio and via command-line interface with TestCloud environments.

In the next chapter, we'll show you how to connect and use TestCloud in Katalon TestOps to schedule and run tests in TestCloud environments.

Hi, in the previous lesson, you've learned how to configure and run Katalon Studio tests with different browsers, versions, and OS. Now, I will show you how to schedule test runs with TestCloud in TestOps. First, let's log into Katalon TestOps. Navigate to testops.katalon.io. Then, enter your Katalon account credentials.

This is what my current organization looks like. You can create a new organization by clicking on the dropdown icon in the menu, select ''Create New Organization'' and follow the instructions. In case you're new to Katalon TestOps, it's a platform where you can centralize and orchestrate all testing activities, from test management, planning, execution, integration to reporting.

Alright, to schedule test runs with TestCloud, click on Test Execution. This big Test Run Calendar shows you all the historical test runs, their execution dates, and the results. Continue to select the Schedule Test Runs button in the right corner. Then, you'll need to answer 3 questions: The what, where, and when. Let's walk through each section quickly.

First, give this test run a name. Then, choose the Script Repository where your test suites or test suite collections are stored. If you don't have an existing repository in TestOps, you can create a new one by clicking on ''create a new one here''. It will drive you to the Configuration page where you can easily create a script repository in TestOps. From here, select Create Git Script Repository, choose GitHub or any other source type, paste in the URL to your Git repository. Then, fill in your username and personal access token (you can create by searching and following the guidelines from your specific source code repository). Then, click on Connect.

Go back to the Schedule Test Run section. After giving it a name, choose your script repository. Then, continue to pick what you want to run, test suite or test suite collection. You can also use Katalon or generic command to pick the tests you want to run. I'll go for a test suite. Then, choose to run it on Chrome headless. Next, in the Where to run section, choose TestCloud Test Environment for type. Then, in the TesCloud section below, specify the environment you want. I'll go for Linux, Chrome, and version 97. I aslo want to run this test suite with Windows, Chrome version 99.

Just a quick note, make sure that you turn off the Kobition integration in the advanced settings. At the moment, TestCloud supports web application environments and certain operating systems, Linux and Windows. By the time you watch this course, more options will have been added. Make sure to check them out.

Finally, you need to set up the When to run. You can trigger the test runs and have them repeated after a certain interval in a timeframe. But I want to run this test suite now. To do so, click on the Repeat toggle to turn off the scheduling function. You can see that the Schedule button in the bottom right has turned to Run. Select it.

It will redirect me to the Test Run List tab. Looking at our test in the first line, you can see the name, the location, the test environment (there are two, in this case, one with Linux, and the other one with Windows), the dates of the last and the next run if any. On the right is a little run button that will trigger the test run immediately. You can further click on the name to see all the historical data. From here, you have the option to run, edit, or delete it.

Let's switch to the Report category to see how our tests are running. Continue to select the Test Runs tab and scroll down to the All test runs section. You may not see all the details right now since our tests are still up and running. Continue to click on the ID to view more details of this test run. Scrolling down, you can see the test suite runs two times. The first one with Linux is complete. The second one with Windows is still running. Let's wait a bit until they are complete.

Alright, they are both passed. Further click on the ID of each suite if you want to see the detailed test logs. If you go back to the All test runs section, the results have been fully updated. From the left to the right, the execution status - passed, the ID, the name of the test run and selected test suite, the platforms or environments used to run the tests, the running time, the pass-fail results of this test run. There were 2 tests in total. This suite ran two times with 2 pre-defined environments, meaning each suite has 1 test case. All the tests passed.

And that's what I want to show you in this chapter, scheduling and running tests in TestOps with TestCloud environments. You can now log in to TestOps, try it out, and explore other features. In the next chapter, we show you how to use the TestCloud tunnel to run tests and why you should do so.

Hi! Welcome to the last chapter! Previously, we showed you how to execute tests with TestCloud. In this chapter, we're going to guide you on configuring a TestCloud tunnel to run tests in a private domain. One of the most concerning challenges when using cloud environments is security, especially for enterprises or data-sensitive businesses. To minimize this risk, Katalon TestCloud tunnels are available to ensure a secured connection to your local resources so that you can test your applications in a restricted environment, avoiding unwanted access from the global network, hence, minimizing potential security risks.

To see how it works, open Katalon Studio, select the test suite you want to run, click on the dropdown icon next to the run button, pick TestCloud. Next, check the option Execute with Tunnel for private domain testing. The current status is Not available, indicating you haven't set up a tunnel client yet. To do so, click on the Tunnel Setup Helper. Then, follow the instructions shown on screen.

First, download the tunnel executable file. Unzip it. Then, move it into the Application if you're using a Mac. Get back to the Tunnel Setup Helper, copy the command line. Next, open the command-line interface. Since I'm using Mac, I'll use CMD + Space, type in ''Terminal'' and open it. Paste in the command and press enter to run. After it confirms a successful configuration, start the tunnel by copying and pasting the last command in the dialog to the terminal. It says, ''You can start testing now.'' We're good to go.

Some notes before we move on. By default, the tunnel will close after 30 minutes if there is no request or traffic. To start the tunnel again, you have to enter the run command again. And remember, keep this terminal open until your test execution is complete. Alright, go back to the Tunnel Setup Helper and hit Refresh. The status will turn to Available in green. Now, choose your desired operating system, browser, and version. I'll leave it as it is. Then, select Run.

Looking at the Job Progress, ''Tunnel=true'' indicates the use of a tunnel in this test execution. In the Log Viewer, you can even see the tunnel ID here. Switch to the terminal, you'll see it says, ''tunnel session is activated,'' then ''created,'' and then ''closed'' for each test execution. While it's running, let's talk about some of the best practices to optimize the usage of the TestCloud tunnel.

First, use just one tunnel for each suite execution or build and then close it down when everything is done. Second, use a machine with good internet connection and a large bandwidth to minimize test flakiness. Third, make sure your machine has high specs when running many tests in one go. Finally, use one tunnel per machine to minimize test failures due to timeout or bandwidth issues. Let's wait until our test run is finished...

Once it's done, you can click on the Result tab to view the test results and other information, or download the reports by clicking on Export Reports. And that's how you configure and run tests in Katalon Studio on a private domain via TestCloud Tunnel. In the last lesson, I'll show you how to do the same, but this time in Katalon TestOps.

You've known how to configure the TestCloud tunnel in Katalon Studio. In this last lesson, we're going to show you how to do exactly that, but this time, in Katalon TestOps. After logging in to your TestOps, you'll need to configure and active a tunnel first. Click on Configurations > TestCloud Tunnels > Setup. Follow the instructions.

Download and unzip the TestCloud tunnel executable file (you can skip this step if you've downloaded it). Then, copy the command on the screen and paste it into your CLI. Continue to paste the other command in to start the tunnel. It says, ''a new tunnel session has been created'' and ''you can start testing now.'' Back to TestOps, clicking on the Tunnels, you can see a new tunnel has been created and active. Remember to leave your CLI open during the test execution.

Now, go to Test Execution > Schedule Test Run > give it a name first. To run tests in a private domain or locally, click on the toggle Use TestCloud tunnel to turn it on. Next, choose your tests and the TestCloud environment. To run this immediately, turn off the Repeat toggle. Then, click on Run. It will direct us to the Test Run List page. Next to the test run name, there's a tunnel icon, indicating it involves the use of TestCloud tunnel.

Click on the Reports category, then the Test Run tab, you can see our test is up and running. Let's wait for a few seconds until the execution is complete. Our test run passed. You can continue to click on the ID if you want to view more details of this test run. Click on the ID in Session, if you want to view the test log of this execution. And that concludes our final lesson and also our course. Well done!

To recap, you've learned:

- The advantages of Katalon TestCloud: easy to use and easy to integrate within the Katalon platform

- How to run tests with TestCloud environments in Katalon Studio and TestOps

- Finally, the steps to set up the TestCloud tunnel to run tests in a private domain for better security

What's next? Go to Katalon.com/download, install Katalon Studio to create your tests and run them with TestCloud. Katalon Academy is working on even more courses to help you learn about test automation and immediately put them into practice with Katalon tools. In the meantime, you can watch more of our existing courses by clicking on the Courses button right on the top menu bar. Thank you, and happy learning!