Read the Docs

Technical reading path

Use this guide to understand TestyAI's technical implementation and evaluation priorities. For a product overview, see Documentation.

Execution lifecycle

Every test case execution follows a governed lifecycle:

1. Setup Phase: Execute prerequisite test cases (e.g., login, data preparation)
2. Dependencies Phase: Run dependent test cases in dependency order
3. Main Phase: Execute the primary test case with subtask iteration and recovery
4. Verification Phase: Validate expected outcomes and collect evidence
5. Cleanup Phase: Tear down state and release resources

Each phase is observable via real-time SignalR events and recorded in structured execution logs.

Artifacts and evidence

TestyAI generates multiple artifacts per execution:

• result.json – Structured execution result with status, timing, and error details
• llm-conversation.md – Full LLM reasoning and tool call sequence
• Screenshots – Timestamped browser screenshots at key execution points
• Screenshot manifest – JSON index of all screenshots with metadata

All artifacts are stored per execution and retrievable via API for post-run analysis.

CI/CD integration

TestyAI exposes a REST API for CI/CD pipeline integration:

• Trigger suite run: POST to /api/test-suites/{id}/runs with environment and tag filters
• Poll for completion: GET /api/test-suite-runs/{runId} until status is terminal
• Retrieve JUnit report: GET /api/test-suite-runs/{runId}/junit for pipeline-native XML format

Authentication uses JWT tokens scoped to company context.

Preparing for a pilot

Before evaluating TestyAI with your team, consider:

• Which web application workflows are most critical and time-consuming to test manually
• What environment URLs and credentials are available for test execution
• How test results integrate with your existing CI/CD pipeline (Jenkins, GitHub Actions, GitLab CI, etc.)
• What success metrics define a successful pilot (coverage, execution time, defect detection rate)

Next steps

For a high-level product overview, return to Documentation. To express interest in early access, join the waitlist.