AI Tester - Senior QA Automation Engineer (Selenium & AI Testing)

Job Summary

We are seeking a highly skilled Senior QA Automation Engineer with 6+ years of experience in Software Functional Testing and 4 7 years of expertise in Selenium. The ideal candidate will lead system integration testing, ensure adherence to quality standards, and develop AI-specific automated testing frameworks.

This role requires expertise in Agile methodologies, test automation tools, and AI model evaluation using LLMs and RAG architectures.

Key Responsibilities

• Conduct system integration testing for new and enhanced applications.
• Develop and execute automated tests using Selenium and other industry-standard tools.
• Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts.
• Ensure on-time delivery by monitoring dependencies, progress, and milestones.
• Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance.
• Lead project and quality management initiatives, including issue tracking and communication.
• Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports.
• Ensure compliance with Agile methodologies, maintaining detailed process documentation.
• Perform AI-specific testing, including validation of LLMs and RAG architectures using vector databases.
• Implement automated testing frameworks for Gen AI applications, such as DeepEval and RAGAs.
• Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness.
• Test prompt engineering techniques to refine AI-generated responses.
• Execute SQL queries in Snowflake to validate database integrity and application responses.

Essential Skills & Experience

• 6+ years of experience in Software Functional Testing with automation expertise in Selenium.
• Experience with Jira and ALM for test and issue tracking.
• Strong proficiency in Python, with experience in AI testing frameworks such as LangChain, Pytest, and PyTorch.
• Hands-on expertise in LLM & RAG architecture testing using vector databases.
• Familiarity with Snowflake, SQL querying, and data validation techniques.
• Excellent communication and leadership skills to engage with stakeholders.

Skills

Agile Programming Methodologies, Application Framework, Artificial Intelligence (AI), Atlassian JIRA, Automation Engineering, Communication Skills, Data Quality, Documentation, Forecasting, Functional Testing, Industry Standards, Integration Testing, Leadership, Maintain Compliance, Pytest, Python Programming/Scripting Language, Quality Assurance, Quality Assurance Methodology, Quality Management, Quality Metrics, Resource Utilization, SQL (Structured Query Language), Scripting (Scripting Languages), Selenium, Snowflake Schema, Software Testing, System Integration (SI), System Test, Test Automation, Test Harness, Test Tools, Test Vector, Testing, Time Management, Time Tracking, Validation Testing

About the Company

Macpower Digital Assets Edge Private Limited