In unit testing we often mock various objects, libraries and side effects. For example it can be a response from some web service. But what should we do in integration and functional tests?

Ok, you develop a Kodi add-on and you would like to have CI for your code. What options do you have? How Kodi add-ons can be tested? And how to configure a CI for a Kodi add-on code? Let me share my experience.

During add-on development I use Kodi installed on my operating system for testing. But what if I need to test my changes on various Kodi versions? It's not so easy to install different versions of a package on such distros as Ubuntu. We could try some Kodi container image but I decided to build my own.

I guess all of you who have worked on UI testing know the "locator" problem. In order to find an element in the DOM you need to provide a locator and usually it's an XPath string. Sometimes that xpath can be quite nontrivial and in one day developers change the code and your locator cannot find the required element. In order to avoid such situations as much as possible my colleagues Peter Savage, Ronny Pfannschmidt and Karel Hala have developed a specification for frontend developers Open Web UI Design Specification for Enabling Automation (OUIA). If your application complies with OUIA it will have predictable locators and the behavior. This significantly simplifies writing automated tests.

Imagine you have a group of repositories in Gitlab and you would like to have the same pipelines for whole group.

When you test your web application with Selenium there is a one fundamental problem. Due to dynamic nature of modern web pages you cannot interact with elements on the web page immediately after loading. What can we do with that?

As a quality engineer I responsible for testing various parts of a product. One of such part can be the web UI. But before your first UI test will be executed you will need to configure a lot of things. It might be a non-trivial task. Kubernetes can be quite helpful here and be actual "one ring to rule them all".