Web QA Automation Engineer

Location: Remote - India
Req#: 611863
Apply
Company Information

 We’re reinventing the market research industry. Let’s reinvent it together.

At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

Job Description

Role overview

This role combines hands-on manual and exploratory testing with automation of the PanelSmart web dashboard and its APIs. You will assess changes against requirements, investigate risks that scripted tests may miss, and build reliable Playwright and API checks for important administrator and respondent workflows. You will work closely with product, development, and QA colleagues to provide clear evidence about quality and release risk.

Core technology stack

Playwright, TypeScript, Node.js, API testing, GitHub Actions, Git, and Allure reporting.

What you will do

Manual and exploratory testing

  • Review user stories and acceptance criteria; identify ambiguities, dependencies, and edge cases before implementation is complete.

  • Perform functional, exploratory, regression, and release-focused testing of the web dashboard and integrated workflows.

  • Validate user journeys across projects, folders, questions, survey creation and publishing, reports, resources, and respondent experiences.

  • Report defects with reproducible steps, environment details, expected and actual results, and relevant evidence; retest fixes.

Web UI automation

  • Design and maintain end-to-end browser tests with Playwright and TypeScript using reusable fixtures, page objects, and test data.

  • Automate agreed critical workflows such as login, dashboard administration, project and folder management, question authoring, and survey publishing.

  • Use assertions, traces, screenshots, and Allure reports to make test outcomes useful and failures diagnosable.

  • Investigate flaky tests and distinguish product defects from test, data, and environment issues.

API testing and CI

  • Develop and maintain API tests for authentication, surveys, respondent management, reports, resources, push, and other supported services.

  • Validate response status, schemas, data, authentication behavior, and error cases; maintain reusable clients and test data where appropriate.

  • Run and maintain UI and API suites through the team’s GitHub Actions workflows, review results, and improve reporting and feedback.

Collaboration and quality practices

  • Contribute to refinement and risk analysis so requirements are testable and coverage targets important user and business risks.

  • Use exploratory findings and production or support feedback to prioritize regression coverage and automation.

  • Contribute code through Git-based review workflows and share testing knowledge with the wider team.

Skills & Requirements   

Required experience and skills

  • 3-5 years of hands-on experience with manual functional and exploratory testing of web applications.

  • Practical experience building browser automation; Playwright with TypeScript or JavaScript is the primary stack for this role.

  • Experience with API testing, including authentication, response and data validation, and negative cases.

  • Experience integrating automated tests into CI pipelines and interpreting test results.

  • Understanding of maintainable automation design, test data, debugging, and defect reporting.

  • Working knowledge of Git, code review, and collaborative Agile delivery.

  • Clear communication and effective collaboration with product, development, and QA teams.

Helpful additional experience

Exposure to AI-assisted test analysis, flaky-test classification, semantic retrieval or locator-recovery approaches can be useful. Changes proposed by AI tools must remain reviewable and follow the team’s repository and approval controls.

How success is measured

  • Manual and exploratory testing identifies meaningful product risks and communicates them before release.

  • Critical agreed web and API workflows have reliable, maintainable automated coverage.

  • Test results and defect reports are timely, reproducible, and useful for release decisions.

  • CI failures are triaged promptly, and avoidable flakiness and maintenance effort are reduced.

  • Automation and regression coverage keep pace with product changes and agreed priorities.

 

There is strength in numbers - We are the Numerati

Numerator is 5,800 employees strong. We have the confidence to be real and embrace what makes each Numerati unique. Our diverse experiences, ideas and backgrounds fuel our innovation.

Being part of the Numerati means that we’ll take care of you! From our Recharge Days, maximum flexibility policy, wellness resources for employees and their families, development opportunities and much more — we’re always finding ways to better support, celebrate and accelerate our team.