Hercules

End-to-end software test automation has traditionally struggled to keep up with development cycles. Every time the engineering team updates the UI or platforms like Salesforce or SAP release new updates, maintaining test automation frameworks becomes a bottleneck, slowing down delivery. On top of that, most test automation tools are expensive and difficult to maintain.

That’s why we built an open-source AI-powered testing agent—to make end-to-end test automation faster, smarter, and accessible for teams of all sizes.

High level flow:

Write natural language tests -> Agent runs the test -> Results, screenshots, network logs, and other traces output to the user.

Installation:

pip install testzeus-hercules

Sample test case for visual testing:

Feature: This feature displays the image validation capabilities of the agent    Scenario Outline: Check if the Github button is present in the hero section     Given a user is on the URL as  https://testzeus.com      And the user waits for 3 seconds for the page to load     When the user visually looks for a black colored Github button     Then the visual validation should be successful

Architecture:

We use AG2 as the base plate for running a multi agentic structure. Tools like Playwright or AXE are used in a REACT pattern for browser automation or accessibility analysis respectively.

Capabilities:

The agent can take natural language english tests for UI, API, Accessibility, Security, Mobile and Visual testing. And run them autonomously, so that user does not have to write any code or maintain frameworks.

Comparison:

Hercules is a simple open source agent for end to end testing, for people who want to achieve insprint automation.

1. There are multiple testing tools (Tricentis, Functionize, Katalon etc) but not so many agents

2. There are a few testing agents (KaneAI) but its not open source.

3. There are agents, but not built specifically for test automation.

On that last note, we have hardened meta prompts to focus on accuracy of the results.

If you like it, give us a star here: https://github.com/test-zeus-ai/testzeus-hercules/