Chapter 1 - Setting up Katalon Studio and TestOps
Chapter 2 - Uploading Test Results on TestOps
Chapter 3 - Summary
This course gives a demonstration of how you can streamline DevOps and test automation using the power couple of Katalon Studio and TestOps.
These three chapters will cover:
Setting up and integrating TestOps with Katalon Studio
Creating and executing tests in Katalon Studio
Generating insightful and detailed reports from your test execution
Chapter 1 - Setting up Katalon Studio and TestOps
Before we begin, there are a couple of things that you need to make sure you have already set up, so we can continue working on this demo. The first thing is that you need an actual Katalon account so you can access Katalon TestOps on your browser in the machine that you're working with. Also, you have to have a running instance of Katalon Studio in your environment as well.
Now, I am going to go ahead and access Katalon TestOps using my account. Once I log in, you will see that I've already had an organization going on. This is what you will see if you already have been using Katalon TestOps. In the case that you're new to this and you don't have an organization, the first thing that you want to do is go ahead and create an organization.
I already have some created. But let's go to the steps of creating a new one. Click on "Create an Organization" and just go ahead and type the name in here. Let's call this the "Katalon TestOps Demo Organization" and then we go ahead and click on "Create." This is going to take us to create our first project. So now we're going to leave these by default. Then the first project that we're going to create is called "Katalon TestOps video project."
We can go ahead and create a project. Then we are good to go. We want to leave everything by default, so what I'm going to do is just click "Next." And then we are going to go ahead and finish this process. Now I can go ahead and go to my organization. As you can see, I don't have any data that has been uploaded here and that is what we're going to do in the second step.
Now what we need to do is we're going to come here to Katalan Studio and make sure that we are connected to our TestOps. For that, I'm going to go to the 'Project settings' and then hit on 'Settings' right here on the menu. Then, we are going to navigate to Katalon TeskOps. Right now, because I have done this multiple times, I already have my credentials in the case that it looks different to you.
Make sure that you click here in 'Overwrite authentication'. Go ahead and put in the URL for TestOps and then use the same credentials that you are working with. Now what I'm going to do is I'm going to go ahead and fetch the organizations, so the latest organization that I created shows up which is the Katalon demo here. So, I'm going to click on that one and then I am going to also fetch the projects. This is going to refresh in the background and then it's going to pull the 'Video project' that I want to work with. So now what I want to do is just click 'Apply and close'. This is going to be good to go.
So now we're ready to start creating a test case and a test suite. We're going to go ahead and create a test case and a test suite and see how we can interact with Katalon TestOps. The first step is we need to go ahead and create a test suite here. The reason for that is that you cannot upload only one test case to Katalon TestOps. So, we're going to go ahead and call these tests. Let's go ahead and click 'OK' to save this. When that is ready, we are going to go ahead and go here and create the test case that we want to work with. Just create a new test case, very simple, 'new test case demo'. We are going to save that as well.
Very important, now we need to go ahead and record the steps for the script that we want to create. Remember it doesn't matter if you know how to code or not, this is very simple. What we're going to do is click on 'Record web.' This is going to open this dialog window where you can select the URL for the test environment that you want to work with.
In this case, I already have this demo automatic Katalon.com. So what I'm going to do is I'm going to go ahead and hit 'Record'. This is going to open automatically an URL where the test environment is. In this case, it is a healthcare service where I can go ahead and make an appointment. So, let's go ahead and take some actions here.
I'm going to hit the 'Make an Appointment' button. I'm going to try the ''John Doe'' username and the password is ''ThisIsNotAPassword.'' Then we go ahead and type and click on 'Login.' Success! So now we can go ahead and select the facility where we want to be seen. We also can apply for the hospital medicare. Doesn't matter. You can go ahead and select the date that you want to have an appointment. Then, you can say ''thank you.'' Now, we're going to go ahead and take another action and book the appointment. So, everything went well here. Last but not least, let's go back to the homepage and see how it works.
Everything seems to be working just fine. When we are done recording the steps, let's just go ahead and hit the 'Stop' button right here. You will see all the steps, all the actions that we just took. Now, we're going to go ahead and save that script. I'm getting an emerging notification here because I already have some built-in information in there. But I'm going to go ahead and click 'OK' and now we're good to go.
So now what I'm going to do is I'm going to open my test suite. I'm going to drag my test case in there. If we go back to Katalon TestOps, you will see that we only have the project in there. There is nothing already uploaded because we have not executed the test. We just did the recording. So, what we want to do now is I want to go ahead and execute this record or execute this test.
What is going to happen is it's going to go ahead and do it. It's going to run it on Chrome. In a few seconds, it's going to open a Chrome environment where it's going to go ahead and run all the steps. Once all the steps are executed, it's going to tell us that it's continuing running and preparing the report. Then it's going to upload this report to Katalon TestOps.
Alright, while that happens, I can go back and let's go ahead and execute these a couple more times. But in this case, I am going to make it fail on purpose. So, we can see the difference in how that looks in Katalon TestOps. In this case, in my machine, I don't have Firefox installed. This is going to actually fail once I try to execute it. Let's go ahead and run the same steps. Just select Firefox. It is going to try to open Firefox and that is where it's going to fail.
We are going to see here all the results and it's telling me there is something going on. I can see the root cause. It's going to go ahead and upload that report as well to Katalon TestOps. Let's go ahead and run another one where it is actually going to execute correctly. Here we go. Now, this is uploading again to Katalon TestOps. So in this case, let's go ahead and navigate to Katalon TestOps and see what we have.
Chapter 2 - Uploading Test Results on TestOps
Now, this is uploading again to Katalon TestOps. So, in this case, let's go ahead and navigate to Katalon TestOps and see what we have. Everything was updated here automatically. I didn't have to do anything manually. So, what I'm going to do is I'm going to go ahead and refresh my Katalon TestOps and see that there is one test case that was executed and there were three different executions that I had for the test suite that I created.
The first one was a success. The second one, remember I told you I was going to make fail on purpose because I tried to open it on a web browser that I don't have. The third one actually executed successfully. So let's go ahead and take a look at this project. Let me click on that and see if we can dig deeper into what is going on.
So, we have here the information three of them passed. Actually, two of them passed out of three and one of them failed. We have the report here that is telling us exactly what is happening. It is giving us an overview of what is going on with your environment. Now let's go to 'Reports & Analytics' and see if we can dig deeper into what is going on here. Something interesting about Katalon TestOps is that your reports or in this case the data that you will see in this graph. You will see the newest tests on the left-hand side and the oldest ones you will see on the right-hand side.
So you can see what data was executed, which one failed, which one didn't. It's going to also give you details on each one of these test executions, how many times it was executed, how many times it failed and passed, and you name it. If you want to see details on why is this failing or why is it succeeding. You can go here and click on the ID number, this is going to take you to the details of this test execution.
Here, you will see that it failed. You also can go ahead and take a look and see why it failed. So here, you will see all the details about this test execution and it also will give you a log of what is going on. In that way, you don't have to dig through endless log files to see exactly what is going on with your environment or why this is failing. It also gives you some detailed information about how this looks like if you have been running it for multiple days.
I'm going to go to a different project that I have going on here. I actually have to switch organizations. In this case, I have one where I've been running a little bit more tests. You will see that I have here actually had multiple ones that passed and failed. If I go to 'Reports & Analytics', you will see more details about them. So this is going to give you valuable insights into how you are performing, how your tests are performing what if certain days you have more failures.
You can go ahead and keep track of that. You can go ahead and take swift action on what is going on. Another cool thing about this is that not only you can go to the dashboard and see all these insights that you can take swift action on but also you can do test planning. You can go ahead and plan all the tests that you want prior to your release and make sure that everything is running smoothly in your pipeline. You also can manage your tests and, as I mentioned just now, you can go ahead and visit the 'Reports & Analytics' and take a look at what is going on. Also, you can go ahead and navigate to 'Configurations' and see how can you integrate TestOps with the rest of your environment.
Chapter 3 - Summary
So, to give you a summary of what we just did, we made sure that we had an account with Katalon TestOps. We also had a running environment of Katalon Studio. We created a test suite. We also created a test case which we moved into the test suite. And, we executed that multiple times in Chrome and also Firefox. We saw how that was uploaded to Katalon TestOps because we also have here the configuration that we created to integrate Katalon TestOps with Katalon Studio where everything is going to get uploaded.
Last but not least, we went here into Katalon Studio and took a look at how the insights are being built for you automatically. Also, you can see details of what is going on which one of your tests. You can go ahead and do your planning management configuration and look at all the insights all in one place. I hope that you enjoyed this demo and please do not hesitate to reach out if you have any questions. See you next time! Bye bye.