2024

AI Test
Optimizer

This product helps QA professionals work more efficiently by providing tools to create test cases and scenarios, with a strong emphasis on artificial intelligence integration. It automatically generates project structures and enables users to easily set up automated testing bots. The tool is part of the client’s platform and connects directly with other solutions used to manage digital transformation.

Client
A Big Four accounting firm
Industry
Information Technology
Services
Discovery & Research
UX/UI Design
Vibe Coding
Design System
User Testing
Responsibilities
Product Design
Management
AI Test Optimizer project view
AI Test Optimizer running on a laptop

Challenge

The client’s portfolio includes numerous products that go through similar testing stages. Therefore, the main goal was to develop a tool that significantly speeds up and optimizes the testing process using artificial intelligence, while remaining flexible enough to accommodate projects of various scales.

  1. 1.

    Create an AI-driven product to significantly improve and simplify test management workflows.

  2. 2.

    Ensure seamless integration of the product into the global project management system & tools.

  3. 3.

    Develop a customizable reporting system and bot dictionaries.

Client mark

Solution

Through ongoing iterative collaboration with the business and development teams, we developed an approach to automatically generate test cases and test scenarios based on the client’s extensive project database. We implemented functionality to connect and flexibly configure a range of testing bots, and the product integrates seamlessly with the client’s existing project management system.

Bot DictionariesTaxonomiesAdmin PortalNotification SystemAuto Generation of Test Scenariosand more

/ Test Case Generation

The product can automatically create various entities within the project structure based on related user stories and AI trained on the client’s project data.

Test case generation interface

/ Feature 1

Generation Results

The results can be reviewed, and necessary adjustments made either manually or via a prompt that quickly updates case descriptions and metadata.

Generated test case results

/ Feature 2

Test Scenarios

Test scenarios are sets of cases that need to be covered, including information about the team and the time allocated for the work.

Test scenarios view

/ Feature 3

Global Library

This section stores all current project structures and dictionaries used by the testing bots.

Global library of project structures

/ Feature 4

Bot Dictionary

This page allows creating bots for automatic verification of necessary parameters or actions, such as testing product inputs or checking data compliance.

Bot dictionary configuration

Results

The project started as a small concept with a limited budget. However, collaboration with the design team uncovered clear opportunities for automation and AI integration, significantly simplifying testers’ work. The team proposed many ideas, some of which were incorporated into the final product. Stakeholders quickly recognized the project’s potential, and it is now actively evolving as one of the flagship products in the client’s portfolio.

  1. 1.

    Reduced testing time by 24%

    Lay the groundwork for future sustainability-focused products and establish a unified visual language.

  2. 2.

    Testing via the product became standard

    Using the product has become a mandatory step in the testing process for the company’s employees.

  3. 3.

    81% of users rated the tool as “easy to use”

    Surveys showed positive results, with most testers giving very positive feedback after a month of use.

  4. 4.

    Improved the work monitoring system

    Email notifications and time estimation features have improved process transparency and helped ensure commitment to deadlines.