Owns the stability, accuracy, and signal quality of automated test execution by systematically analyzing, debugging, and resolving failing scripts across pipelines.
Key Responsibilities:
- Execute and monitor pipelines in Azure DevOps
- Categorize failures: Test defect vs environment vs data vs code
- Track trends and provide triage reporting
- Script-Level Debugging & Root Cause Analysis
- Debug automation scripts written in: Playwright / Selenium
- Identify root causes such as:
- Flaky selectors (dynamic DOM changes)
- Synchronization/timing issues (wait conditions)
- Assertion mismatches
- Data dependency failures
- Validate API failures using: Postman or GraphQL tools
- Inspect logs and telemetry (App Insights, pipeline logs)
Requirements
- Strong debugging and analytical skills
- Experience with logs, APIs, and UI troubleshooting
- Familiarity with test automation lifecycle
- Experience with observability tools (App Insights, Azure monitoring)
- Mortgage/FinTech experience