Company Description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work on a scale across all devices and digital mediums, and our people exist everywhere in the world (17000 plus experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

Job Description

Role - Senior QA Automation Tester

Location - Evanston, Illinois USA

Work Model - Onsite - Hybrid (3 days a week work from office)

Employment type - Full-time

Job Overview:

• Role Summary We are looking for an Application Tester / QA Engineer who can ensure the quality, reliability, and correctness of web applications, mobile and Gen AI-enabled systems.
• The role requires a strong analytical mindset, hands-on experience with automated testing frameworks, features.

What You’ll Do Web & UI Testing:

• Test UI workflows using Selenium, Cypress, or Playwright.
• Validate cross-browser behaviour, UI responsiveness, and user interaction flows.
• Identify UI edge cases, broken states, and usability issues. GenAI / NLP Output Validation
• Test NLP and GenAI-powered features, including o Chat-based interfaces o Text generation, summarization, and extraction outputs
• Validate LLM outputs for: o Functional correctness o Format and schema adherence o Edge cases and failure scenarios
• Design test cases for non-deterministic outputs, including prompt variations and response consistency.
• Identify hallucinations, incorrect grounding, and unsafe responses where applicable.

Defect Tracking & QA Governance:

• Document defects clearly with reproducible steps, expected vs actual results, and logs.
• Maintain test plans, test cases, and QA reports.
• Support QA governance through structured documentation and reporting.
• Track test coverage and quality metrics across releases.

Qualifications

Must have skills:

• Minimum 7 years of experience as a QA Automation.
• AI testing exposure, API Testing (Capable), Playwright with Java, Python (Strong)
• Experience testing web applications and mobile testing.
• Hands-on experience with Postman for API validation.
• Familiarity with Selenium for UI automation.
• Strong analytical skills for identifying edge cases and failure scenarios.
• Ability to write clear, structured test documentation and defect reports.
• Ability to write clear, structured test documentation and defect reports.

Nice-to-Have Skills:

• Experience testing NLP or GenAI-based applications.
• Familiarity with validating LLM outputs, prompts, and structured responses.
• Experience with CI/CD-integrated testing.
• Exposure to performance or load testing tools.
• Understanding of basic database validation for test verification.

Additional Information

Disclaimer: Nagarro is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will be afforded equal employment opportunities without discrimination based on race, creed, color, national origin, sex, age, disability, or marital status.