Senior QA Engineer (AI & Feature Testing)

About the role

Solvd, an AI-native consulting and technology services firm, is hiring a Senior QA Engineer to build and validate AI-powered and traditional features for a leading personal finance platform. The role covers quality across web, mobile and API, with a focus on testing AI/LLM-integrated components where standard deterministic methods do not apply. It suits someone who understands the difference between testing software with a right answer and evaluating AI outputs with a probability distribution.

Key responsibilities

• Plan, design and execute test cases for AI-powered components and traditional features, choosing eval-based or deterministic methods according to the target behavior.
• Analyze functional requirements, AI model behavior specifications, prompt outputs and edge-case scenarios.
• Turn business requirements, user flows and process procedures into test plans, test cases and test scripts.
• Perform manual feature testing across platforms and verify bug fixes.
• Create detailed defect reports and document unexpected AI model responses, hallucinations and performance regressions.
• Help develop QA practices for emerging technologies such as AI frameworks and share best practices across the team.
• Become a subject matter expert in core systems, interfaces, business processes and reporting tools.
• Partner with functional teams, engineers and IT in a global environment with aligned LATAM working hours.

Required profile

• 5-7 years of experience in software testing across web, mobile and API.
• Hands-on experience with Playwright in a production environment (primary requirement).
• Hands-on AI feature testing experience, validating AI/LLM products for accuracy, relevance, robustness against adversarial prompts, edge cases and safety/toxicity.
• Clear understanding of eval versus deterministic testing, including human-in-the-loop evaluations, score metrics, benchmark datasets and semantic evaluation.
• Strong understanding of web and mobile development lifecycles, including iOS and Android specifics.
• Proven experience in integration, regression, performance/load and UAT testing.
• Preferred: experience with HTML proxy tools such as Charles Proxy or Fiddler, Xcode and ADB logs, and the financial services or fintech domain.
• Bachelor's degree in Computer Science or equivalent.

Required skills

• Playwright
• Browser DevTools and log monitoring
• Jira and Confluence (advanced proficiency)
• Test management systems

The role is full-time. Solvd describes itself as an equal opportunity employer.