Archive for December, 2015

Test Oracles address a mutex problem that is faced by all teams who *successfully* practice continuous deployment. The problem test oracles address is: once your tests have run, and you have the results, how do you know what that means? In other words, what are you testing? What do your tests tell you? How do you know what you know?

Command line tools provide powerful data analytics when applied to a mature CI system and deployment pipeline. Such systems are known to be opaque — but the GNU/bash command line environment is powerful enough to solve those problems (with a little help from HTML5!).

A healthy CI system and deployment pipeline will naturally accrue a wealth of filesystem artifacts which can be mined for Test Oracles using command-line tools. Topics covered in depth will include:

• JSON testing and transformation with jq.
• Jenkins monitoring tips.
• Network analysis tools for Selenium developers.
• Visualizing xUnit test runner output.
• Analyzing your captured screenshots.
• Tips on introducing new dashboards to your team.

By providing yourself and your team not just with data but with actionable oracles, you will discover new reservoirs of activity that can safely become automated-rather-than-manual work.

In this talk I want to compare typical tasks performed by test automation engineers, and their implementation in Java and Groovy. The main message of the report is to show the participants the tools and libraries that will allow test engineers to be more efficient and to solve typical tasks in a short time. Working with files, working with Json and XML files, creating customers for REST and SOAP services – all of this can be simplified by using the flexibility of Groovy and reliability of Java. This talk will be interesting and helpful not only for test automation engineers, but also for people from the manual testing, because they will learn about the simple and reliable tools that will help them to solve daily routine tasks.

There are a lot of books and publications about the continuous integration in the world. But in my experience it’s difficult to find information about how to open quality gates between automated tests and to continuous integration practice to in your current project. After reading several articles and even a couple of books you will understand how to work with it. But what next? I will share with you practical tips and tricks on how to lift iron curtain to your automated tests before a continuous quality practice today. It is for this reason why I am pleased to share with you my acquired experience in my presentation.

The tools and practices refined over the last decade by web developers have not crossed over easily into the mobile community. Mobile devs have been without tools like continuous integration and automated testing, which enable delivery of high-quality apps more rapidly. A key piece of the solution for mobile is Appium, an open-source, cross-platform, language-agnostic mobile automation framework you can use to write automated UI tests for Android and iOS apps (native, hybrid, web), to be run on emulators or devices.

In this talk we will explore the philosophy that underlies the work behind Appium, including the open-source nature of Appium’s diverse, active and friendly community. Then, after a brief explanation of the technology that powers Appium, we’ll move into the technical portion of the talk, where attendees will see easy it is to write Appium scripts using the WebDriver protocol in their favorite language.

Ultimately, the talk provides an argument for moving from manual QA to automated testing for mobile, an understanding of the mobile automation landscape, and a solid introduction to Appium, which leading projects and companies around the world have chosen as their mobile automation framework of choice.

Automated visual testing is a major emerging trend in the dev/test community. In this talk you will learn what visual testing is and why it should be automated. We will take a deep dive into some of the technological challenges involved with visual test automation and show how modern tools address them. We will review available Selenium-based open-source and commercial visual testing tools, demo cutting edge technologies that enable running cross browser and cross device visual tests at large scale, and show how visual test automation fits in the development/deployment lifecycle.

If you don’t know what visual testing is, if you think that Sikuli is a visual test automation tool, if you are already automating your visual tests and want to learn more on what else is out there, if you are on your way to implement Continuous Deployment or just interested in seeing how cool image processing algorithms can be, this talk is for you!

Almost every test automation team invent their own framework. They put lots of efforts and time to build and polish it adapting to all possible situations. Most of them finish with a garbage that require continuous support or huge gap in test coverage because time was spent on framework instead of tests themselves. I’m quite sure nobody needs a framework in the first place. Instead we need quick, reliable, simple tests that work and provide good quality gates for our development process. Framework could be introduced in more natural way when it is really needed and could solve existing issues or improve something. I will demonstrate on the practical examples how to go with evolution approach using Selenium/WebDriver.