Documentation

What TestyAI does

TestyAI is an AI-powered web QA platform that transforms natural language specifications into verified test evidence. The system plans, executes, and verifies browser-based test cases, providing real-time progress updates, actionable artifacts, and CI/CD integration for automated quality gates.

Core capabilities

• Planning and Regeneration: Generate test plans from feature descriptions, validate via replay, and regenerate plans automatically when replay fails
• Governed Execution: Run test cases with lifecycle awareness (Setup → Dependencies → Main → Verification → Cleanup), bounded recovery, and quality gates
• Verification and Artifacts: Collect execution results, screenshots, LLM conversation logs, and structured evidence for every run
• Project Research: Build application maps through safe, read-only exploration of target web applications
• Feature Batch Runs: Execute all test cases for a feature in a single coordinated suite run
• CI/CD Integration: Trigger suite runs via API, poll for completion, and receive JUnit XML reports for pipeline integration

Who it's for

TestyAI is designed for engineering teams who need:

• Faster test coverage for complex web workflows without manual script maintenance
• Verification evidence tied to natural language requirements
• Automated regression checks integrated into CI/CD pipelines
• Real-time visibility into test execution and failure root cause

Next steps

This overview helps you understand the product surface. For more technical details about execution lifecycle, artifacts, and implementation, see Read the Docs.